¶ Data Sync Strategies Overview
Elementrix supports multiple methods for syncing data from source systems to data products:
Data Source → Sync Strategy → Data Product → API Access
¶ Available Strategies
- Manual Creation - Type schema manually
- JSON Sample Creation - Upload sample file
- Database Schema Export - Connect to database
- Elementrix Staging - Custom staging area
¶ Choosing the Right Strategy
| Strategy | Best For | Advantages | Disadvantages |
|---|---|---|---|
| Manual | Simple schemas, learning | Full control, no source needed | Time-consuming, manual updates |
| JSON/CSV | Existing files, prototyping | Fast, auto-detect types | Requires sample data |
| Database | Tables/views, real-time sync | Production-ready, automated | Needs database access |
| Staging | Unsupported sources, custom ETL | Flexible, handles any source | Requires custom code |
¶ Recommended Data Sync Structure
Best Practices:
- Use Normalized Data (2NF/3NF)
- Include Audit Columns: created_at, updated_at
- Use Appropriate Keys: UUID or BIGINT primary keys
- Optimize for Incremental Sync: Index on updated_at
¶ Next Steps
- Learn about Manual Creation
- Explore JSON/CSV Upload
- Set up Database Connectors
- Configure Staging Data Source