Skip to main content

Basic Concepts

This guide introduces the core concepts of the PilottAI framework.

Framework Architecture

PilottAI is designed around a modular, hierarchical architecture:

Core Components

  1. Serve: The main orchestrator that manages agents, routes jobs, and coordinates execution.
  2. Agents: Autonomous entities that perform specific jobs using LLMs and tools.
  3. Jobs: Units of work that are routed to appropriate agents for execution.
  4. Memory: Storage system for context, job history, and knowledge.
  5. Tools: Integrations and capabilities that agents can use to accomplish jobs.
  6. Orchestration: Systems for scaling, load balancing, and fault tolerance.

Agents

Agents are the primary actors in the PilottAI framework. Each agent:
  • Has a specific title and goal
  • Can use tools to interact with external systems
  • Utilizes LLMs for decision-making and job execution
  • Maintains its own memory and context

Agent Types

PilottAI supports different agent types:
  • Orchestrator: Manages and delegates jobs to worker agents
  • Worker: Executes specific jobs using specialized capabilities
  • Hybrid: Combines orchestration and execution capabilities

Agent Configuration

Agents are configured using the AgentConfig class:

Jobs

Jobs represent units of work that agents perform. Each job:
  • Has a description and context
  • May be assigned to a specific agent or automatically routed
  • Has a priority level
  • Tracks execution status and results

Job Lifecycle

Job Creation

Memory System

PilottAI includes a sophisticated memory system that:
  • Stores job execution history
  • Maintains agent context
  • Enables semantic search and retrieval
  • Supports knowledge persistence

Memory Components

  1. Job Memory: Records job execution details
  2. Semantic Memory: Stores knowledge and context
  3. Enhanced Memory: Advanced memory with pattern recognition

Using Memory

LLM Integration

PilottAI uses Large Language Models for agent intelligence. Key concepts:
  1. LLM Configuration: Settings for model, provider, and parameters
  2. LLM Handler: Manages LLM interactions with proper error handling
  3. Function Calling: Structured LLM output for tool use

LLM Configuration

Tools

Tools extend agent capabilities by providing:
  • External system integrations
  • Specialized functionality
  • Job-specific utilities

Tool Creation

Orchestration

PilottAI includes advanced orchestration features:

Dynamic Scaling

Automatically adjusts the number of agents based on system load:

Load Balancing

Distributes jobs across agents to optimize performance:

Fault Tolerance

Handles agent failures and ensures system reliability:

Next Steps

Now that you understand the basic concepts of PilottAI, you can: