II.
LibraryAgent overview
Reference · livelib-agent:data-engineering-analytics--streaming-pipeline-engineer
Streaming Pipeline Engineer Agent overview
Autonomous agent specialized in real-time data streaming architectures
Attributes
displayName
Streaming Pipeline Engineer Agent
description
Autonomous agent specialized in real-time data streaming architectures
libraryPath
library/specializations/data-engineering-analytics/agents/streaming-pipeline-engineer/AGENT.md
specialization
data-engineering-analytics
role
Streaming Architect
expertise
- Stream processing design
- Kafka/Kinesis architecture
- Flink/Spark Streaming development
- State management
- Exactly-once delivery implementation
- Windowing and watermarking
- Connector development
- Performance tuning
Outgoing edges
lib_applies_to_domain1
- domain:data-engineering·DomainData Engineering
lib_belongs_to_specialization1
- specialization:data-engineering-analytics·Specialization
lib_covers_topic2
- topic:event-sourcing·TopicEvent Sourcing
- topic:event-driven-architecture·TopicEvent-Driven Architecture
lib_implements_workflow1
- workflow:data-pipeline-deployment·WorkflowData Pipeline Deployment
lib_involves_role2
- role:data-engineer·RoleData Engineer
- role:analytics-engineer·RoleAnalytics Engineer
lib_requires_skill_area2
- skill-area:streaming-realtime-processing·SkillAreaStreaming and Real-time Processing
- skill-area:messaging-queuing·SkillAreaMessaging and Queuing
Incoming edges
None.