Features
Powerful capabilities for production-ready LLM orchestration: intelligent routing, quality assurance, streaming, and more.
Core Features
Decision Points
Conditional branching based on quality scores or field values. Build adaptive workflows with recursive refinement.
Processing Order
Control field generation sequence and manage dependencies for complex workflows.
System Prompts
Customize LLM behavior with global or field-specific system prompts for role and tone control.
Data Fetching
Enrich generations with external data from APIs, databases, or custom endpoints.
Quality Assurance
Built-in validation, epistemic scoring, and automated refinement for production quality.
Streaming Requests
Stream responses in real-time with field-by-field updates for interactive applications.
Batch & Priority System
Process multiple requests efficiently with intelligent batching and priority management.
Byte Operations
Generate images, convert text-to-speech, and transcribe audio with verbose metadata and word-level timestamps.