Charles Wang

10 Database Schema Best Practices

10 Database Schema Best Practices

Follow these tips to ensure that your database schema delivers maximum utility for data warehouse users, data analysts, and data scientists.

11 Database Schema Mistakes to Avoid

11 Database Schema Mistakes to Avoid

A good database schema is indispensable for making data warehouses work. Get it wrong, and you’ll be in a world of hurt.

Data Lakes vs. Data Warehouses

Data Lakes vs. Data Warehouses

Successful analytics depends on choosing the right approach to storing your enterprise data.

What Is the Modern Data Stack?

What Is the Modern Data Stack?

A radically new approach to data integration saves engineering time, allowing engineers and analysts to pursue higher-value activities.

ETL vs. ELT: Choose the Right Approach for Data Integration

ETL vs. ELT: Choose the Right Approach for Data Integration

Learn about ETL and ELT so you can decide which method works for you.

Product Managers! Join Us at #mdscon 2021

Product Managers! Join Us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

Team Leads! Join Us at #mdscon 2021

Team Leads! Join Us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

Applying the Scientific Method to Improve Business Intelligence

Applying the Scientific Method to Improve Business Intelligence

The scientific method is a proven route to successful, tested and verified improvement. Here’s how to combine it with BI.

What Is a Database Schema?

What Is a Database Schema?

Use schemas to make life easier for your analysts and engineers.

Data Analysts! Join Us at #mdscon 2021

Data Analysts! Join Us at #mdscon 2021

This year's conference features speakers and sessions for data professionals of all kinds.

Data Engineers and Data Architects! Join Us at #mdscon 2021

Data Engineers and Data Architects! Join Us at #mdscon 2021

This year's Modern Data Stack Conference features speakers and sessions for data professionals of all kinds.

Database Schema Design: Best Practices for Integration and Analysis

Database Schema Design: Best Practices for Integration and Analysis

Learn how to design normalized schemas that make life easier for analysts and data engineers.

How to Handle HIPAA Concerns With Cloud Data Warehouses

How to Handle HIPAA Concerns With Cloud Data Warehouses

Achieve HIPAA compliance and reduce risk while offloading some of your operational burden.

Data Analytics vs. Business Intelligence

Data Analytics vs. Business Intelligence

Should your data team focus on business problems and use cases, or expand into more complex areas like predictive analytics?

Business Intelligence: What You Need to Know

Business Intelligence: What You Need to Know

Business intelligence is the art of extracting actionable insights from your data. There’s a whole stack of technologies under the hood.

Data Warehouse vs. Database

Data Warehouse vs. Database

Data warehouses are a particular kind of database. Learn how they are uniquely suited to analytics.

The Importance of ETL Security

The Importance of ETL Security

ETL security is essential for safeguarding your customer's data and complying with regulations. Learn about the Fivetran approach.

dbt Explained

dbt Explained

Learn how dbt adds data modeling and transformation to the modern data stack.

Introducing the Fivetran Protocol

Introducing the Fivetran Protocol

Here's how SaaS providers can build bulletproof data replication APIs.

Data Transformation Fundamentals, Uses and Tools

Data Transformation Fundamentals, Uses and Tools

Data can transform a struggling business into a successful one, but first, you need to transform the data. Here’s how.

Key Considerations for Pipeline Performance

Key Considerations for Pipeline Performance

Data pipeline performance hinges on several important techniques, including algorithmic optimization and parallelization.

What Is a Data Lakehouse?

What Is a Data Lakehouse?

The data lakehouse is a promising new technology that combines aspects of data warehouses and data lakes.

When to Use NoSQL and MongoDB

When to Use NoSQL and MongoDB

What is MongoDB used for? Learn how MongoDB and its Fivetran connector can help you.

SQL vs. NoSQL: Database Differences Explained

SQL vs. NoSQL: Database Differences Explained

What is NoSQL, and what does it bring to the table?

ETL Platform Alternatives: Fivetran vs. Informatica and More

ETL Platform Alternatives: Fivetran vs. Informatica and More

Compare popular data integration tools on cost, security, reliability and number of supported sources.

Which Connectors Does Your ETL Tool Need?

Which Connectors Does Your ETL Tool Need?

Make sure your data integration solution can connect to critical data sources.

How to Compare ETL Tools

How to Compare ETL Tools

Use these criteria to choose the best ETL tool for your data integration needs.

What Is ETL?

What Is ETL?

How do data integration architectures work, and how are they continuing to evolve?

Network Performance and Data Integration

Network Performance and Data Integration

Data integration can easily become non-performant. Learn about some common bottlenecks.

What Is Fully Managed ELT?

What Is Fully Managed ELT?

Fully managed ELT allows data integration to be outsourced and automated, saving precious engineering time.

Five Things I’ve Learned From Building Analytics Stacks at J.P. Morgan and Fivetran

Five Things I’ve Learned From Building Analytics Stacks at J.P. Morgan and Fivetran

These data management best practices apply to both large enterprises and fast-growing startups.

Why ELT Will Disrupt ETL

Why ELT Will Disrupt ETL

ETL, long a mainstay of data integration, is labor-intensive, brittle, complex — and ripe to be supplanted by ELT.

The Ultimate Guide to Data Integration

The Ultimate Guide to Data Integration

This guide is a one-stop introduction to data integration. Learn how to make data-driven decisions a reality for your organization!

The Dangers of DIY Database Replication

The Dangers of DIY Database Replication

Database replication for database analytics involves many serious difficulties.

Process Isolation in Data Pipelines

Process Isolation in Data Pipelines

Process isolation is an important pillar of software engineering that can keep your data pipelines (and you) out of trouble.

The Importance of Database Analytics

The Importance of Database Analytics

Use database connectors to uncover insights about your operations.

Building Efficient Data Pipelines With Incremental Updates

Building Efficient Data Pipelines With Incremental Updates

Sync data incrementally, or watch your pipeline grind to a halt.

Don’t Try This at Home: Building an Idempotent Data Pipeline

Don’t Try This at Home: Building an Idempotent Data Pipeline

Learn about the technical challenges involved in building an idempotent data pipeline.

Idempotence and How It Failure-Proofs Your Data Pipeline

Idempotence and How It Failure-Proofs Your Data Pipeline

Learn how idempotence protects you from the worst consequences of data integration failures.

Database Schema Design Guide

Database Schema Design Guide

Building a data connector requires you to design a schema to structure your data. This is how Fivetran does it.

Database Schema Best Practices

Database Schema Best Practices

Learn how Fivetran provides normalized schemas to make life easier for analysts.

Your Data Access and Transparency Journey

Your Data Access and Transparency Journey

How can your organization ensure data access and transparency? Measure yourself against this model, courtesy of our partners at Slalom.

What Is the Architecture of Automated Data Integration?

What Is the Architecture of Automated Data Integration?

Automated data integration depends on several key concepts.

Build vs. Buy Data Pipelines: An Illustrated Guide

Build vs. Buy Data Pipelines: An Illustrated Guide

Consider these comparisons before you try to build your own data pipeline.

What Is Idempotence?

What Is Idempotence?

Idempotence is an important characteristic of many systems, including Fivetran. Here's what it means.

Three Kinds of Metrics GitHub Data Can Answer

Three Kinds of Metrics GitHub Data Can Answer

Data from GitHub can help your engineers quantify how they are doing.

Five Dashboards to Jump-Start Your Analytics

Five Dashboards to Jump-Start Your Analytics

Consider building these dashboards that help answer essential business questions.

 Why You Need Automated Schema Migration

Why You Need Automated Schema Migration

Schema changes can completely disrupt a data pipeline. Automated data integration offers a solution.

The Definitive Glossary of Data Integration Terms

The Definitive Glossary of Data Integration Terms

New to analytics? Don’t know what an ERD is? Read this comprehensive list of important data integration terms.

How Fivetran Built Its Klaviyo Connector

How Fivetran Built Its Klaviyo Connector

The process of building a connector is inextricably linked with schema design.

How Well-Designed Schemas Jump-Start Analytics

How Well-Designed Schemas Jump-Start Analytics

Fivetran customers share how data integration gets easier with well-designed schemas.

Build vs. Buy: By the Numbers

Build vs. Buy: By the Numbers

Wondering whether to build or buy? This infographic puts numbers to the issue.

Build vs. Buy: A Comparison

Build vs. Buy: A Comparison

Wondering whether to build or buy? Consider these quality-of-life tradeoffs before you make a decision.

Seven Steps to Getting Started With Automated Data Integration

Seven Steps to Getting Started With Automated Data Integration

In this excerpt from The Essential Guide to Data Integration, we discuss practical steps to getting started with automated data integration.

Top Technical Considerations for Choosing an ETL Tool

Top Technical Considerations for Choosing an ETL Tool

In this excerpt from The Essential Guide to Data Integration, we discuss the technical considerations for choosing a data integration tool.

Top Business Considerations for Choosing an ETL Tool

Top Business Considerations for Choosing an ETL Tool

In this excerpt from The Essential Guide to Data Integration, we discuss the business considerations for choosing a data integration tool.

Why You Shouldn't Build Your Own Data Pipeline

Why You Shouldn't Build Your Own Data Pipeline

In this excerpt from the Essential Guide to Data Integration, we discuss why you shouldn’t build your own data pipeline.

A Primer to Customer Attribution

A Primer to Customer Attribution

Demystify customer decision-making with the right tracking tools and attribution models.

Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data

Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data

NetSuite is essential but complicated. Use this guide to set up dashboards for all your NetSuite data.

Use Fivetran, BigQuery and Looker to Get a Handle on NetSuite Data

Use Fivetran, BigQuery and Looker to Get a Handle on NetSuite Data

NetSuite is essential but complicated. Use this guide to set up dashboards for all your NetSuite data.

BI Tools Comparison

BI Tools Comparison

BI tools can drive data literacy across your organization. Here’s how to choose the right one.

Treat Pipeline Automation Deficiency Syndrome Before It’s Too Late

Treat Pipeline Automation Deficiency Syndrome Before It’s Too Late

Don’t miss these warning signs for pipeline automation deficiency! Your organization’s health depends on it.

A Primer to the World of Data

A Primer to the World of Data

How does data become useful knowledge and products?

A Primer to the World of Data

A Primer to the World of Data

How does data become useful knowledge and products?

A Friendly Reminder: One Plus NULL Equals NULL

A Friendly Reminder: One Plus NULL Equals NULL

Whenever you perform arithmetic across SQL columns, take care to handle NULL values appropriately.

Your Data Stack Should Live in the Cloud

Your Data Stack Should Live in the Cloud

For most organizations, on-premises is over. The future? Managed services in the cloud.

Simple and Automated Always Beats Complex and Handwritten

Simple and Automated Always Beats Complex and Handwritten

Fivetran Transformations offers a radically simpler approach to modeling data for reports and dashboards.

Get Started With the “T” in ELT

Get Started With the “T” in ELT

Use Fivetran Transformations to prepare your data for reporting.

Machine Learning in One Lesson

Machine Learning in One Lesson

You don’t need Python chops to get started with simple predictive models, just BigQuery ML and Looker (Fivetran helps, too!).

Now in BETA: Custom Roles

Now in BETA: Custom Roles

Tighten your security by specifying the exact sources your users can manage.

Now in BETA: Fivetran REST API

Now in BETA: Fivetran REST API

Use our REST API to automate your workflow by programmatically managing users, groups and connectors.

Instant Data Stack: Fivetran, Snowflake and Tableau

Instant Data Stack: Fivetran, Snowflake and Tableau

Want to deploy a full-fledged data stack in minutes? Connect Fivetran through Snowflake Partner Connect, then connect Snowflake to Tableau. That's it!

How to Think About Schema Changes

How to Think About Schema Changes

Prevent schema changes from ruining your workflow with help from Fivetran.

Google Ads (AdWords) Connector Now Comes With Prebuilt Reports

Google Ads (AdWords) Connector Now Comes With Prebuilt Reports

We now offer five prebuilt AdWords reports to give you a head start on ad analytics.

Why You Shouldn’t Build Reports From Raw Data

Why You Shouldn’t Build Reports From Raw Data

Or, how I learned to stop worrying and love data warehousing.

Build Connector Status Dashboards With the Fivetran REST API

Build Connector Status Dashboards With the Fivetran REST API

Learn how to combine AWS Lambda and the new Fivetran REST API to build connector status dashboards.

Simpson’s Paradox: Beware the Lurking Variable

Simpson’s Paradox: Beware the Lurking Variable

You can easily reach misleading conclusions if you don’t carefully slice your data, consider lurking variables, and think about causality.

Cloud Data Warehousing: It's Time to Re-Think Your Data Architecture

Cloud Data Warehousing: It's Time to Re-Think Your Data Architecture

A digest of Fivetran CEO George Fraser's talk about the merits of cloud data warehousing at MicroStrategy World 2019.

An Introduction to Looker Blocks and LookML

An Introduction to Looker Blocks and LookML

Use Looker Blocks to conduct plug-and-play analyses with data from our standardized connectors.

Use Lambda Functions to Move Data From Redshift

Use Lambda Functions to Move Data From Redshift

Learn how to incrementally migrate data from Redshift tables using AWS Lambda.

Choose the Right Metrics

Choose the Right Metrics

What gets measured gets managed. Make sure you measure the right things, identify vanity metrics, and perform sanity checks.

Fivetran and the Hierarchy of Data Needs

Fivetran and the Hierarchy of Data Needs

Your business's data needs follow a hierarchy, and Fivetran can give you a step up.

Don't Try This at Home: Fivetran Makes NetSuite’s API Usable

Don't Try This at Home: Fivetran Makes NetSuite’s API Usable

Understand the history of the Fivetran NetSuite connector and you'll see why you shouldn't try building your own.

Funnel Analysis and Conversion Metrics in SQL

Funnel Analysis and Conversion Metrics in SQL

Using SQL to conduct funnel analysis can help you make sense of multiple facets of your business.

Build vs. Buy: Some Back-of-the-Envelope Costs

Build vs. Buy: Some Back-of-the-Envelope Costs

A few simple calculations illustrate why it's ill-advised to build your own data pipeline.

How to Write Cloud Functions in Python

How to Write Cloud Functions in Python

We walk you through the process of setting up a cloud function connector using Python and Google Cloud Platform Functions.

Start analyzing your data in minutes, not months

Launch any Fivetran connector instantly.