GCP Data Storage Cheat Sheet
Cloud Storage
- Store immutable object > 10MB
- Batch, near real-time uploads
- Backup, global scale, secure storage
- Google Cloud Console: gsutil, user, root
Cloud SQL (Relational DB)
- Managed relational DB with support for MySQL, PostgreSQL
- Transaction System (ACID)
- Small to medium workload
- Web framework & existing apps
Cloud Spanner (Relational DB)
- Scalable relational DB for high availability & global applications
- For large-scale transaction apps
- Needs SQL query with horizontal scalability
Cloud Firestore (NoSQL)
- NoSQL document DB for mobile and web apps
- Serverless NoSQL
- Real-time sync for mobile apps
- Automatic real-time synchronization
- Offline query supported
BigQuery (Data Warehouse)
- Data warehouse & analytics for large data sets
- Serverless architecture with auto-scaling
- Massive dataset and SQL-like queries
- Big data, real-time analytics
Bigtable (NoSQL)
- NoSQL for time series & large scale data
- High throughput, low latency
- IoT, user analytics, monitoring systems
Cloud Dataproc
- Managed Apache Hadoop & Spark
- After instance creation of Bigtable, infrastructure not charged
- Large scale transfer from low network to high network