Onboarding ETL vs. Data Ingestion Feature

Onboarding ETL

When you provide historical batch data, Optimove’s data engineers handle the setup of your ETL process to ensure a smooth integration.

Key Steps in the ETL Process:

• Extract: Retrieve data from your sources.
• Transform: Format and align the data with Optimove’s schema.
• Load: Import the transformed data into Optimove’s system.

Comprehensive ETL Setup Includes:

• Scheduling automated ETL runs.
• Validating data to ensure accuracy and consistency.
• Implementing error management to address potential issues promptly.

For complex data requirements or custom integrations, consider Optimove’s paid data engineering services for tailored support.

Post-Onboarding

Once onboarding is complete, you can manage new data independently using Optimove’s self-serve Data Ingestion feature:

• Effortlessly upload fresh data from various sources.
• Maintain full control over your data updates without relying on external support.

ETL Process

The ETL Form outlines the essential parameters and configurations needed to facilitate seamless data extraction, transformation, and loading processes for Optimove.

Key sections include:

1. Check Data Exists (CDE):
   This procedure ensures the reliability of data by comparing current data metrics with historical averages. It validates that sufficient data is received.

2. Table-Level Details:
   Lists all data tables, their primary key (PK) fields, and data sources (e.g., Files, Databases, APIs).

3. Data Missing or CDE Failures:
   For missing files or CDE failures, two options are available:

   • Fail Daily Process: Halts updates and campaign execution until the issue is resolved, with notifications sent to the client.
   • Don’t Fail Daily Process: Allows updates and campaign execution to continue, with notifications sent to the client.

4. Retroactive Updates:
   Optimove supports scenarios involving retroactive data updates, provided the table includes a date field (not a 'LastUpdated' field).

   • Please note: Clients must notify Optimove if retroactive updates are expected.