II.
LibraryProcess overview
Reference · livelib-process:data-engineering-analytics--scd-implementation
scd-implementation overview
Slowly Changing Dimension (SCD) Implementation - Implement Type 2 SCD patterns for historical tracking in data warehouses, including merge logic, surrogate key generation, temporal tracking fields, versioning, late-arriving data handling, and comprehensive testing.
Attributes
displayName
scd-implementation
description
Slowly Changing Dimension (SCD) Implementation - Implement Type 2 SCD patterns for historical tracking in data warehouses,
including merge logic, surrogate key generation, temporal tracking fields, versioning, late-arriving data handling, and comprehensive testing.
libraryPath
library/specializations/data-engineering-analytics/scd-implementation.js
specialization
data-engineering-analytics
references
- - The Data Warehouse Toolkit (3rd Edition) - Ralph Kimball: https://www.kimballgroup.com/data-warehouse-business-intelligence-resources/books/ - Slowly Changing Dimensions: https://en.wikipedia.org/wiki/Slowly_changing_dimension - Kimball SCD Techniques: https://www.kimballgroup.com/2008/08/slowly-changing-dimensions/ - Type 2 SCD Best Practices: https://www.kimballgroup.com/2013/02/design-tip-152-slowly-changing-dimension-types-0-4-5-6/ - dbt Snapshots Documentation: https://docs.getdbt.com/docs/build/snapshots
example
const result = await orchestrate('specializations/data-engineering-analytics/scd-implementation', {
projectName: 'Customer Dimension SCD',
dimensionTables: ['dim_customer', 'dim_product', 'dim_supplier'],
scdType: 'type-2',
targetPlatform: 'Snowflake',
sourceSystem: { database: 'production_db', schema: 'public' },
testingStrategy: 'comprehensive',
includeType1Attributes: true,
enableAuditLogging: true
});
usesAgents
- dimensional-analyst
- key-architect
- temporal-architect
- merge-engineer
- ddl-architect
- load-engineer
- incremental-engineer
- late-arrival-specialist
- lookup-engineer
- test-engineer
- performance-engineer
- monitoring-engineer
- orchestration-engineer
- technical-writer
- implementation-validator
Outgoing edges
lib_applies_to_domain1
- domain:data-engineering·DomainData Engineering
lib_belongs_to_specialization1
- specialization:data-engineering-analytics·Specialization
lib_implements_workflow1
- workflow:data-pipeline-deployment·WorkflowData Pipeline Deployment
uses_agent4
- lib-agent:scientific-discovery--dimensional-analyst·LibraryAgentdimensional-analyst
- lib-agent:shared--test-engineer·LibraryAgenttest-engineer
- lib-agent:software-architecture--performance-engineer·LibraryAgentperformance-engineer
- lib-agent:meta--technical-writer·LibraryAgenttechnical-writer
Incoming edges
None.