¶ Data Sync Strategies Overview
Elementrix supports multiple methods for syncing data from source systems to data products:
Data Source → Sync Strategy → Data Product → API Access
¶ Available Strategies
- Manual Creation - Type schema manually
- JSON Sample Creation - Upload sample file
- Multi-Datasource - Connect to multiple databases (PostgreSQL, MySQL, Oracle, SQL Server)
- S3 Integration - Import from S3 buckets (CSV, JSON, Parquet, Avro)
- Elementrix Staging - Custom staging area
¶ Choosing the Right Strategy
¶ Recommended Data Sync Structure
Best Practices:
- Use Normalized Data (2NF/3NF)
- Include Audit Columns: created_at, updated_at
- Use Appropriate Keys: UUID or BIGINT primary keys
- Optimize for Incremental Sync: Index on updated_at
¶ Next Steps
- Learn about Manual Creation
- Explore JSON/CSV Upload
- Configure Multi-Datasource Architecture
- Configure S3 Integration
- Configure Staging Data Source