¶ Discovery & Access
¶ Discover Data Products
¶ Public Page
Each published data product has a public discovery page accessible to all users.
Page Sections:
1. Header Section:
Product Name: Customer Transaction History
Status Badge: 🟢 Published
Domain: Finance
Owner: finance-team@company.com
Quick Actions:
[Request Access] [View API Docs] [Export Metadata]
2. Overview Tab:
# Overview
Complete history of customer transactions including purchases,
returns, and refunds. Updated in real-time with sub-second latency.
## Key Features
- 7-year historical data (2018-present)
- Real-time CDC from production database
- 99.9% SLA uptime guarantee
- Rich query capabilities
## Use Cases
- Revenue analysis and forecasting
- Customer behavior insights
- Fraud detection and prevention
- Chargeback management
- Subscription tracking
3. Metadata Section:
Classification: INTERNAL
Update Frequency: Real-time
Data Retention: 7 years
Record Count: 15.2 million
Size: 48 GB
Created: 2024-01-15
Last Updated: 2025-01-25
Version: 2.1.0
¶ Access Agreement
Terms and Conditions:
# Data Access Agreement
By requesting access to this data product, you agree to:
## Permitted Uses
- Internal business analytics
- Report generation
- Machine learning model training
- Application integration
## Prohibited Uses
- Selling or sharing data externally
- Personal use outside business context
- Circumventing rate limits
- Accessing data without proper authorization
## Data Handling
- Treat as INTERNAL classification
- Follow company data retention policies
- Report security incidents immediately
- Delete local copies upon access revocation
## Compliance
- GDPR compliant (EU data subjects)
- PCI-DSS Level 1 (payment data)
- SOC 2 Type II certified
- CCPA compliant (California residents)
## Service Level Agreement
- Uptime: 99.9%
- Response Time: < 200ms (p95)
- Rate Limit: 1000 requests/minute
- Support: data-support@company.com
## Data Retention
- Online: 7 years
- Archive: 10 years
- Purge Policy: After 10 years
I have read and agree to these terms.
[Cancel] [Agree and Request Access]
After Agreement:
✓ Agreement Accepted
Your access request has been submitted for approval.
Request ID: REQ-2025-01234
Estimated Approval Time: 2-3 business days
You will receive email notifications about your request status.
Track your request: /my-requests/outbox
¶ Meta-data
Complete Metadata View:
Basic Information:
Name: Customer Transaction History
ID: cth-v2-prod
Key: customer-transaction-history
Type: Transactional Data Product
Domain: Finance
Description:
Complete transaction history covering all customer financial
interactions including purchases, refunds, chargebacks, and
adjustments. Data synchronized in real-time from the production
order management system.
Classification: INTERNAL
Sensitivity: Contains financial data
PII: No personal identifiers exposed
Ownership & Stewardship:
Primary Owner: finance-team@company.com
Backup Owner: cfo-office@company.com
Data Stewards:
- john.steward@company.com (Technical Lead)
- jane.analyst@company.com (Business Analyst)
Contributors:
- data-engineering@company.com
- analytics-team@company.com
Technical Metadata:
Schema Version: 2.1.0
Schema Change History: [View Changelog]
Total Fields: 24
Required Fields: 12
Optional Fields: 12
Data Source:
- Type: PostgreSQL
- Database: production_order_db
- Table: transactions
- Sync Method: CDC (Change Data Capture)
- Sync Frequency: Real-time
API Endpoint:
https://api.elementrix.io/v1/data-products/customer-transaction-history
Authentication: Bearer Token (OAuth 2.0)
Rate Limit: 1000 req/min per application
Quality Metrics:
Completeness: 99.8% (last 30 days)
Accuracy: 99.95% (validated against source)
Timeliness: < 5 seconds lag (p95)
Consistency: 100% (referential integrity maintained)
Last Quality Check: 2025-01-25 14:00 UTC
Next Scheduled Check: 2025-01-26 14:00 UTC
Usage Statistics:
Active Consumers: 23 applications
Total API Calls (30d): 15.2 million
Average Response Time: 145ms
Peak Usage: 15:00-16:00 UTC daily
Top Consumers:
1. Business Intelligence Dashboard (42%)
2. Fraud Detection System (28%)
3. Revenue Reporting (18%)
4. Customer Analytics (12%)
Tags:
Domain: finance, transactions, customer
Type: transactional, real-time, historical
Use Case: analytics, reporting, ml-training
Compliance: pci-dss, gdpr, sox
¶ Schema
Schema Explorer:
Data Product: Customer Transaction History
Schema Version: 2.1.0
Total Fields: 24
┌─ Core Transaction Fields ────────────────────────┐
│ transaction_id UUID PRIMARY KEY │
│ transaction_number String(20) UNIQUE │
│ transaction_date Timestamp REQUIRED │
│ transaction_type Enum REQUIRED │
│ Values: [PURCHASE, REFUND, ADJUSTMENT] │
│ status Enum REQUIRED │
│ Values: [PENDING, COMPLETED, FAILED, REVERSED] │
└──────────────────────────────────────────────────┘
┌─ Customer Information ───────────────────────────┐
│ customer_id UUID REQUIRED │
│ → References: customers.customer_id │
│ customer_segment Enum REQUIRED │
│ Values: [PREMIUM, STANDARD, BASIC] │
└──────────────────────────────────────────────────┘
┌─ Financial Data ─────────────────────────────────┐
│ amount Decimal(10,2) REQUIRED │
│ Min: 0.00, Max: 1000000.00 │
│ currency_code String(3) REQUIRED │
│ Format: ISO 4217 │
│ tax_amount Decimal(10,2) OPTIONAL │
│ discount_amount Decimal(10,2) OPTIONAL │
│ net_amount Decimal(10,2) COMPUTED │
│ Formula: amount - discount_amount + tax_amount │
└──────────────────────────────────────────────────┘
┌─ Payment Information ────────────────────────────┐
│ payment_method Enum REQUIRED │
│ Values: [CREDIT_CARD, DEBIT_CARD, BANK_TRANSFER, WALLET] │
│ payment_provider String(50) OPTIONAL │
│ payment_reference String(100) OPTIONAL │
│ payment_status Enum REQUIRED │
│ Values: [AUTHORIZED, CAPTURED, FAILED, REFUNDED] │
└──────────────────────────────────────────────────┘
┌─ Audit & Metadata ───────────────────────────────┐
│ created_at Timestamp AUTO │
│ updated_at Timestamp AUTO │
│ created_by String(100) AUTO │
│ ip_address String(45) OPTIONAL │
│ user_agent String(255) OPTIONAL │
└──────────────────────────────────────────────────┘
[Download Schema] [View JSON Schema] [Export as DDL]
Field Details (Example):
Click any field for detailed information:
Field: transaction_amount
Technical Details:
- Name: transaction_amount
- Display Name: Transaction Amount
- Data Type: Decimal(10, 2)
- Required: Yes
- Unique: No
- Indexed: Yes
- PII: No
- Sensitive: No
Description:
Total transaction value in the specified currency, including
all line items but before taxes and discounts.
Business Rules:
- Must be greater than 0
- Maximum value: 1,000,000.00
- Precision: 2 decimal places
- Rounding: HALF_UP
Quality Attributes:
- Completeness: 100% (required field)
- Validity: 99.99% (range validated)
- Format: ##,###.00
Linked Semantic:
→ Transaction Amount [View Term]
Sample Values:
- 49.99
- 1,299.00
- 15,750.25
Statistics (Last 30 Days):
- Min: 0.01
- Max: 125,000.00
- Avg: 287.45
- Median: 89.99
- Null Count: 0
¶ Semantics
Semantic Mappings:
Data Product: Customer Transaction History
Linked Business Glossary Terms: 8
┌─ Transaction Terms ───────────────────────────────┐
│ Transaction ID │
│ Definition: Unique identifier for each transaction│
│ Mapped Fields: transaction_id, transaction_number│
│ Category: Financial Data │
│ [View Term Details] │
│ │
│ Transaction Amount │
│ Definition: Total monetary value of transaction │
│ Mapped Fields: amount, net_amount │
│ Category: Financial Metrics │
│ [View Term Details] │
└────────────────────────────────────────────────────┘
┌─ Customer Terms ──────────────────────────────────┐
│ Customer ID │
│ Definition: Unique customer identifier │
│ Mapped Fields: customer_id │
│ Category: Customer Data │
│ [View Term Details] │
│ │
│ Customer Segment │
│ Definition: Customer tier classification │
│ Mapped Fields: customer_segment │
│ Category: Customer Analytics │
│ [View Term Details] │
└────────────────────────────────────────────────────┘
┌─ Payment Terms ───────────────────────────────────┐
│ Payment Method │
│ Definition: Method used for payment processing │
│ Mapped Fields: payment_method, payment_provider │
│ Category: Payment Processing │
│ [View Term Details] │
└────────────────────────────────────────────────────┘
[View All Related Products Sharing These Terms]
[Add More Semantic Mappings]
Cross-Linking:
Products Sharing "Transaction Amount" Term:
1. Revenue Forecasting Model
Domain: Finance
Fields: projected_revenue, actual_revenue
[View Product]
2. Customer Analytics Dashboard
Domain: Marketing
Fields: customer_ltv, avg_transaction_value
[View Product]
3. Fraud Detection System
Domain: Security
Fields: transaction_value, suspicious_amount
[View Product]
¶ Applications
Consuming Applications:
Applications with Access: 23
Active Applications (15):
┌────────────────────────────────────────────────┐
│ Business Intelligence Dashboard │
│ Access Level: Full │
│ Granted: 2024-06-15 │
│ Last Access: 2025-01-25 14:23 UTC │
│ API Calls (30d): 6.4M │
│ Rate Limit: 1000/min │
│ [View Details] [Revoke Access] │
└────────────────────────────────────────────────┘
┌────────────────────────────────────────────────┐
│ Fraud Detection System │
│ Access Level: Real-time Feed │
│ Granted: 2024-08-22 │
│ Last Access: 2025-01-25 14:25 UTC │
│ API Calls (30d): 4.2M │
│ Rate Limit: 2000/min (priority) │
│ [View Details] [Revoke Access] │
└────────────────────────────────────────────────┘
[Show All 23 Applications]
Pending Access Requests: 3
[Review Pending Requests]
Access Request History:
- Total Requests: 87
- Approved: 76 (87%)
- Rejected: 8 (9%)
- Withdrawn: 3 (3%)
¶ API Wiki
API Documentation:
API Endpoint:
GET https://app-test.elementrix.io:9063/fetcher/hr/salaries/
Authentication:
Bearer Token (OAuth 2.0)
Header: Authorization: Bearer {your_token}
Rate Limits:
- Standard: 1000 requests/minute
- Burst: 100 requests/second
Response Format: JSON
Content-Type: application/json
Generate token:
curl --location 'https://keycloak-test.elementrix.io:8443/realms/elementrix/protocol/openid-connect/token' \
--header 'Content-Type: application/x-www-form-urlencoded' \
--data-urlencode 'grant_type=client_credentials' \
--data-urlencode 'client_id=salaries' \
--data-urlencode 'client_secret=rdE53nXaVJ8PDC3goRoNApV7XT'
Basic Query get by key:
curl --location 'https://app-test.elementrix.io:9063/fetcher/hr/salaries/1' \
--header 'Authorization: Bearer eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJadFZJUk51Q3VhZi1RVkZPSndZLUs4M1o4ekt6XzV0c3g0eW1MRzdWOC1vIn0.eyJleHAiOjE3NjQ0OTM3OTYsImlhdCI6MTc2NDQ5MzAxNiwianRpIjoidHJydGNjOm_jxy48p2kExdj58IJXjpuKhLr5gMMQt4SCduqZStetgE4NCffWLtd9e0_grCMvIQTusWwGaDMXjHcuav2jf8Khg0ifwKLC14-FGCkBiXOkMQTJAXxJ7Uja2QBeXoXHJHX5LQxFogWipMng0tnBjJ2o_lH8ZwzNRXqZ7CLhc9heM_x6xB_ZvtkcyTqvn4aMET3CS-mn3Tjh45Cjwa6BftGgIankGsZj9s47xEpWK-FKVPw'
¶ Administration View
For Owners and Stewards:
Administration Dashboard
Product: Customer Transaction History
Status: 🟢 Published
Your Role: Owner
┌─ Quick Stats ──────────────────────────────────┐
│ Active Consumers: 23 │
│ Pending Requests: 3 │
│ API Calls (24h): 487,234 │
│ Data Freshness: 4 seconds │
│ Quality Score: 99.8% │
└─────────────────────────────────────────────────┘
Tabs:
- [Metadata] - Edit product information
- [Schema] - Manage schema and fields
- [Access Control] - Manage access requests
- [Applications] - View consuming apps
- [Usage] - Analytics and insights
- [Sync Strategy] - Manage data sync
Metadata Management:
[Edit] Button enabled for:
- Description
- Marketing page
- Tags
- Contributors
Access Control Panel:
Pending Access Requests (3):
1. Mobile App Team
Requested: 2025-01-24
Reason: Customer transaction history for mobile app
Access Level: Read-only
[Approve] [Reject] [Request More Info]
2. External Analytics Platform
Requested: 2025-01-23
Reason: Business intelligence integration
Access Level: Full access
⚠️ External application - requires governance review
[Escalate to Governance] [Reject]
3. Data Science Team
Requested: 2025-01-22
Reason: ML model training dataset
Access Level: Bulk export
[Approve] [Reject] [Request More Info]
Active Grants: [View All 23]
Revoked Access: [View History]
Sync Strategy Details:
Current Sync Configuration:
Source: PostgreSQL Database
Host: db-prod-01.company.internal
Database: order_management
Table: transactions
Sync Method: Change Data Capture (CDC)
Replication Slot: elementrix_transactions
Lag: 4 seconds (current)
Avg Lag (24h): 3.2 seconds
Performance:
Records/Second: 1,247 (avg)
Peak: 8,934 records/second
Data Volume (24h): 2.4 GB
Last Sync: 2025-01-25 14:30:15 UTC
Next Check: 2025-01-25 14:30:20 UTC (5 sec)
Status: ✓ Healthy
[View Sync Logs] [Test Connection] [Modify Configuration]
¶ Next Steps
- Review Administration Overview for system management
- Learn about Roles and Privileges
- Explore Data Product Creation