Data Pipelines

Contents:

• Create data pipeline
  • Extract data
    • Local file system
    • Apromore workspace
    • MySQL and PostgreSQL databases
    • AWS S3 bucket
  • Merge data
    • Inner join
    • Parent-child append
  • Transform data
  • Load data
    • Upload log
    • Schedule pipelines
    • Chaining pipelines
• Schedule data pipeline
  • Loading strategies and eviction periods
• Manage data pipeline
• Share data pipeline