How to Draw a Firebolt

Getting your data to Firebolt is an easy task with Dataddo. If you already have your Firebolt account connected to Dataddo, and you only need instructions on how to connect it to a Data Flow, you can skip Step 1 and start from Step 2 right away.

Firebolt Overview

About Firebolt

Firebolt is a cloud-based data storage and analytics service built over AWS, suitable for massive data sets. you can connect your data to Firebolft quickly with Dataddo.

Prerequisites

In order to connect your data to Firebolt, you need to have:

• An active Firebolt account
• The username and password of your Firebolt account
• A General Purpose engine attached to your database. A general-purpose engine offers read and write ability and better performance compared to other engine types.
• A Firebolt database to which you want to load data.

Tables

When you create a table in Firebolt to run queries over, you must specify whether it’s a FACT or a DIMENSION table. Firebolt handles these table types differently to optimize query performance in general and join operations in particular.

• Fact tables are always sharded across engine nodes. Each node stores part of the table. Use fact tables for your larger and most granular (transaction) tables.
• Dimension tables are replicated in each engine node. Use dimension tables for smaller data sets that are typically more descriptive and are frequently joined with fact tables. When performing joins, the local shard of a fact table on each node is joined with the local copy of the dimension table.

NOTE:

With the Dataddo app, you can create FACT tables. If you need a DIMENSION table, first you need to create the table in the Firebolt (go to Databases > Tables > Add new table) and then send the data to the particular table

If your table does not fit in either of the traditional fact/dimension definition, then it is recommended to define very large tables as fact, and smaller tables as dimensions.

Primary Indexes

Firebolt incorporates several building blocks (indexes) that enable accelerated query response times.

The primary indexes are the main sort key of the table. They will be used as the main tool for data pruning and data distribution.

By using the primary index, Firebolt will read ranges of data from each F3 file. This will reduce the I/O needed to be read, and increase performance dramatically.

How to choose a primary index? Read more in the official documentation.

Limitations

• Once a table is created in the Firebolt database, it cannot be altered, meaning there is no option to add or remove columns. Firebolt does not support this.
• Firebolt supports only Insert (append new data) write mode.

How to connect Firebolt

1. Sign in to your Dataddo account and click onDestinations at the top of the page.

2. Click onCreate Destination in the top right corner.

3. From the list of destinations, choose Firebolt. You can type the name of the connector into the search bar to find it faster.
   

4. Fill out all the files on the sign-in page to give DAtaddo all the necessary information to connect your data, and click on Save.
   

How to Create a New Data Flow

1. Click on Flows at the top of the page.

2. Click onCreate Flow in the top right corner.

3. Click on Add Source to connect it to the destination. You can type the connector's name into the search bar to find it faster.
   

4. Once you select your data source, click on Add Destination.
   

5. From the list of destinations, select the destination. You can also type the name into the search bar.
   

6. Configure the destination by filling out necessary fields.
   
   NOTE: Remember to set the synchronization time for the flow with a little delay after the synchronization of your source to let the data load.

7. Name your flow by typing the name into the top.

8. You can see a Data Preview to make sure of your configuration.
   

9. Click on Save flow.

How to Configure Firebolt Data Flow

In order to send the data to Firebolt.io, the database table must exist.
On the flow first run, Dataddo automatically creates the database table according to your dataset and configuration.

1. Click on the three dots next to the flow and choose Config.
   
2. The window pops up with the configuration details.
   

---

Need assistance?

Feel free to contact us and we will help you with the setup. To speed the process of resolving your issue, make sure you provide us with sufficient information.

Was this article helpful?

taylorwaidamight.blogspot.com

Source: https://docs.dataddo.com/docs/firebolt

Share this post