Data Development
End-to-End Pipeline Design and Scheduling
Enables structured, repeatable data processing for both batch and real-time pipelines.
Core Capabilities
Visual Development Interface
- Dual-view workflow design (process flow & data flow visualization)
- Drag-and-drop node configuration for diverse business requirements
Comprehensive ETL Toolkit
- Multi-source batch data synchronization
- Rich transformation operators for complex ETL operations
- Native JSON parsing for semi-structured data handling
- Spark SQL integration for advanced analytics scenarios
Reliable Scheduling Engine
- Dual-engine architecture (stable + flexible execution modes)
- Loop containers for iterative data processing
- Automated periodic task management
Extended Integration
- Shell script interoperability for external process integration
- Custom API connectivity for hybrid workflow designs