Warp Parse Engine

High-performance data parsing and processing engine built in Rust

Overview

Warp Parse Engine (wp-motor) is a high-performance, modular data parsing and processing engine designed for large-scale data stream processing. It provides the domain-specific language WPL (Warp Processing Language) for defining parsing rules and supports multiple data formats and protocols.

Features

• High Performance: Built with Rust for optimal performance and memory safety
• Domain-Specific Language: WPL (Warp Processing Language) for flexible rule definitions
• Multi-format Support: JSON, CSV, Protobuf, Syslog, and custom formats
• Real-time Processing: Stream processing with sub-millisecond latency
• Extensible Architecture: Plugin system for custom processors and sinks
• Enterprise Ready: Built-in monitoring, metrics, and fault tolerance

Architecture

wp-motor (root)
├── crates/                    # Core libraries
│   ├── orion_overload      # Common utilities and primitives
│   ├── orion_exp         # Expression evaluation
│   ├── wp-config         # Engine configuration management
│   ├── wp-data-utils    # Data structures and utilities
│   ├── wp-parser         # Low-level parsing primitives
│   ├── wp-lang           # WPL (Warp Processing Language)
│   ├── wp-oml            # Object Modeling Language
│   ├── wp-knowledge      # Knowledge database (KnowDB)
│   ├── wp-cli-core       # CLI shared infrastructure
│   ├── wp-cli-utils      # CLI utilities
│   ├── wp-proj           # Project management utilities
│   └── wp-stats          # Statistics collection
├── src/                      # Main application
│   ├── core/               # Core engine
│   ├── runtime/            # Runtime components
│   ├── sources/            # Data sources
│   ├── sinks/              # Data sinks
│   ├── facade/             Public API
│   └── orchestrator/       # Orchestration
└── tests/                    # Integration tests

Feature Flags

• default: Community edition with core runtime
• runtime-core: Base runtime functionality
• enterprise-backend: Enterprise-only backend features
• perf-ci: Performance testing in CI
• dev-tools: Development utilities

Contributing

We welcome contributions! Please see our Contributing Guide for details.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

Support

• Issues
• Discussions

---

Warp Parse Engine（Warp 解析引擎）

用 Rust 构建的高性能数据解析和处理引擎

概述

Warp Parse Engine（wp-motor）是一个高性能、模块化的数据解析和处理引擎，专为处理大规模数据流而设计，具有低延迟和高吞吐量的特点。它提供了领域特定语言（WPL）来定义解析规则，并支持多种数据格式和协议。

特性

• 高性能：使用 Rust 构建，确保最佳性能和内存安全
• 领域特定语言：WPL（Warp Processing Language）用于灵活的规则定义
• 多格式支持：JSON、CSV、Protobuf、Syslog 和自定义格式
• 实时处理：流处理，延迟低于毫秒级
• 可扩展架构：插件系统支持自定义处理器和输出端
• 企业级就绪：内置监控、指标和容错功能

许可证

本项目采用 Apache License 2.0 许可证 - 详情请参见 LICENSE 文件。

支持

• 问题反馈
• 讨论区

---

Warp Parse Dev Team