stack-profile:data-warehouse-bi
Data Warehouse / BI Stack (dbt, BigQuery, Metabase/Looker, Python, Airflow) overview
A modern data warehouse and business intelligence stack where Airflow orchestrates ELT pipelines that land raw data into BigQuery, dbt transforms it into dimensional models with tested, documented SQL, and Metabase or Looker provides self-serve dashboards and ad-hoc exploration for business stakeholders. Python scripts handle custom data source connectors and quality checks. SQL is the primary modeling language across the stack. Designed for data teams in growth-stage companies building their first production analytics layer. The tradeoff is warehouse cost management — BigQuery's on-demand pricing can spike unpredictably with poorly optimized queries, requiring careful slot reservation planning and query governance as usage scales.
Attributes
Outgoing edges
- domain:business-intelligence·DomainBusiness Intelligence
- domain:data-engineering·DomainData Engineering
- language:sql·LanguageSQL
- language:python·LanguagePython
- tool:airflow·ToolApache Airflow
- library:pandas·Librarypandas
- tool:docker·ToolDocker
- platform-service:gcp-bigquery·PlatformServiceGoogle BigQuery
- library:sqlalchemy·LibrarySQLAlchemy
- workflow:dbt-model-review·Workflowdbt Model Review
- workflow:data-pipeline-deployment·WorkflowData Pipeline Deployment
- skill-area:dbt-modeling·SkillAreadbt Modeling
- skill-area:data-warehouse-modeling·SkillAreaData Warehouse Modeling
- skill-area:etl-pipelines·SkillAreaETL Pipelines
- skill-area:data-quality·SkillAreaData Quality
- skill-area:data-analytics·SkillAreaData Analytics
- role:analytics-engineer·RoleAnalytics Engineer
- role:data-engineer·RoleData Engineer
- role:bi-developer·RoleBI Developer