How To Add a Table to an Existing Pipeline

This guide provides step-by-step instructions to add a table to an existing pipeline in Databasin. You will learn how to add and configure a table in a pipeline to include the table in the ingestion automation.

Prerequisites

• You should have an active account on databasin.wustl.edu.
• Basic understanding of database connections and parameters.

Steps

1. Login to Databasin
   1. Navigate to databasin.wustl.edu and log in with your credentials.
2. Select a Project
   1. Once logged in, select the project that contains the pipeline you would like to update.
3. Navigate to the Pipelines Page
   1. In your project, go to the Pipelines page.
4. Open Existing Pipeline
   1. Find the pipeline in the list. You may use the search and/or filter options to help locate the pipeline.
      
5. Open Artifact Dialog
   1. Clicking on the Add new Artifact button will display a dialog to select the tables you would like to include.
6. Select Catalog
   1. Select the catalog/schema from the list shown in the dialog.
      
7. Select Table(s)
   1. Select one or more tables show in the list.
      
8. Data Ingestion Options
   1. This screen allows you to modify various details of the ingestion process for each table. We will leave the default settings for this guide. However, additional information can be found in the Managing Ingestion Options document.
   2. Once the options are configured, click on the All my configurations are set. Continue... button.
   
9. Verify Artifact
   1. The newly selected table(s) should now be listed in the Artifacts for the pipeline.
   2. Select an artifact will show the details, allow. you to view logs, and update the item if needed.