Data Pipelines
Data Ingestion Services
- Amazon Kinesis Data Streams — Real-time stream you build on. Buffer with replay, your code consumes.
- Amazon Data Firehose — Zero-code pipe to storage. Near real-time, no replay, just lands data.
Data Processing Services
- AWS Glue — Fully managed ETL service for data preparation
- Amazon EMR — Large-scale data processing and organizations with existing big data expertise
Data Cataloging Services
- AWS Glue Data Catalog - Centralized, scalable, and managed metadata repository
Data Analysis and Visualization Tools
- Amazon Athena — Use SQL to analyze data in relational, non-relational, object, and custom data sources
- Amazon Redshift — Fully managed data warehouse solution / analyzing large datasets
- Amazon QuickSight — For both techs and non-techs / quickly create interactive dashboards
- Amazon OpenSearch Service — Search for relevant content through keyword matching and natural language queries
Data Storage Services
- Amazon S3 — Popular choice for data lakes
- Amazon Redshift — Fully managed data warehouse solution / analyzing large datasets