Database Storage(Layer 3)
Responsible
- Data loaded into snowflake is reorganized into internal optimized/compressed/columnar format
- Data objects stored by Snowflake are not directly visible nor accessible by custom
...
Database Storage(Layer 3)
Responsible
- Data loaded into snowflake is reorganized into internal optimized/compressed/columnar format
- Data objects stored by Snowflake are not directly visible nor accessible by customers
- Manages all aspects of data(size,compression etc)
Query Processing(Layer 2)
Queries are processed using Virtual Warehouses
- Each warehouse is an MPP compute cluster composed of compute nodes
- Each warehouse is independent compute cluster that does no share compute resources
Cloud Services(Layer 1)
Services Include
- Authentication
- Infrastructure management
§ Metadata management
§ Query parsing and optimization
§ Access Control
How are costs accumulated in Snowflake?
- Based on Storage and compute resources used
- Storage based on amount compressed data
- Data retained for data recovery features
- How big and long warehouse runs
Snowflake is compliant with?
- HIPPA
- PCI DSS
- SOC 1
- SOC 2
- FedRAMP
Other factors that determine costs?
- Region
- On Demand Account
- Capacity Account
What is an On Demand account?
Usage-based pricing with no long term licensing requirements
What is an Capacity account?
Discounted pricing based on an up-front capacity commitment
VPS(Virtual Private Snowflake) accounts have different?
Naming Conventions which results in different hostnames/URLs used to access VPS accounts
Snowflake Connector Ecosystem scales what industries?
-Data Integration
- Business Intelligence (BI)
- Machine Learning & Data Science
- Security & Governance
- SQL Development & Management
- Programmatic Interfaces(Python, JavaScript)
What is a database?
Logical grouping of schemas
What is a schema?
Grouping of database objects, such as:
- Tables
- Views
What is a partition?
A partition is a unit of management that is manipulated independently using specialized DDL and syntax
What is a micro-partition?
Contiguous units of storage
- 50 MB and 500 MB of uncompressed data(Snowflake data is compressed though)
Snowflake stores metadata about partitions such as?
- The range of values for each of the columns in the micro-partition.
- The number of distinct values.
What is Data Clustering in Snowflake?
As data is inserted/loaded into a table, clustering metadata is collected and recorded for each micro-partition created during the process.
Snowflake then leverages this clustering information to avoid unnecessary scanning of micro-partitions
What is data clustering?
Essentially, is how data is sorted.
Metadata for clustering contains?
- Total number of micro-partitions that comprise the table.
- Number of micro-partitions containing values that overlap with each other (in a
[Show More]