~/wiki

Concepts — vue longue

retour à la liste

Toutes les pages concaténées sur un seul document, pour un Ctrl-F direct.

Alan AI Agents Platform

page dédiée →

Enterprise AI agent platform developed by alan-health for operations automation, achieving 70% processing rate and 94% accuracy on blocked-employment-movements. Pioneered git-based-configuration and operations-team-autonomy in agent development, with proven scalability across multiple use cases including Belgium claims processing and sales agents.

The platform represents one of the most successful documented cases of enterprise AI agent deployment, demonstrating how to build scalable, reusable infrastructure that empowers non-technical teams to iterate on AI automation independently.

Core Architecture

Conversational Agents with Tools

  • LLM + Tools Pattern: Combines language models with 15+ business-specific tools
  • Conversational Interface: Multi-turn interactions allowing operator course-correction mid-process
  • Tool Categories: Read-only tools (auto-execute) and write tools (require human approval)
  • Business Actions: Direct database modifications, email sending, record updates

Security and Governance

  • Application-Layer Validation: Tool permissions enforced at code level, not LLM self-policing
  • Human-in-the-Loop: Configurable approval workflows for sensitive operations
  • Audit Trails: Complete tracking of agent actions and human approvals
  • Permission Hierarchy: Granular control over tool access and execution

Integration Philosophy

  • Embedded UI: Agents integrated directly into existing operational tools
  • Workflow Continuity: Maintains operator familiarity while adding AI capabilities
  • Chat Panel Component: Reusable UI component deployable across internal tools
  • Task Orchestration: Integration with existing queue-based workflow systems

Technical Innovations

Git-Based Configuration

Revolutionary approach storing agent configurations in Git repositories rather than databases:

  • Version Control: Full history and branching for safe experimentation
  • Peer Review: Pull request workflows for configuration changes
  • Staging Testing: Branch-based testing without deployment overhead
  • Audit Trail: Complete accountability for configuration modifications

Reusable Platform Components

  • Shared Python Framework: Runtime and base classes used across multiple AI products
  • Generic Chat Panel: Frontend component for embedding in any internal tool
  • Agent Base Class: Handles branching logic, tool validation, and conversation management
  • Backend Infrastructure: Business object association and conversation persistence

Production Performance

After one quarter of deployment on first use case:

  • 70% automation rate of blocked employment movements
  • 25% full resolution without human intervention
  • 94% accuracy measured through expert operator validation
  • 15 tools implemented with configurable human oversight

Scaling Success

Multi-Use Case Deployment

  • Initial: Blocked employment movements (France operations)
  • Second: Belgium claims processing (geographic expansion + document parsing)
  • Third: Sales agent automation (cross-functional validation)
  • Platform: Rapid bootstrapping of new agents across teams

Team Empowerment

  • Operations Autonomy: Non-technical teams modify agent behavior independently
  • Engineering Focus: Platform enhancement rather than individual agent iteration
  • Rapid Deployment: New agents launched with minimal engineering overhead
  • Knowledge Transfer: Patterns applicable across Alan's AI product suite

Future Developments

Meta-Agents Exploration

Investigating agents that can modify other agents' configurations, potentially improving UX while maintaining Git-based infrastructure benefits.

UI Enhancement

Prototyping improved interfaces for operations teams while preserving underlying Git workflow and audit capabilities.

80% Automation Target

North star of fully automating vast majority of operational processes through agent platform scaling.

Industry Impact

This platform represents one of the most thoroughly documented successful enterprise AI agent implementations, providing actionable patterns for:

  • Production-ready agent architecture
  • Human-AI collaboration workflows
  • Scalable platform design
  • Non-technical team empowerment
  • Measurable business outcome tracking

The combination of technical innovation, practical deployment, and measurable results makes this a landmark case study in enterprise AI automation.

See also

Application Layer Validation

page dédiée →

Security architecture pattern for AI agent systems where tool permissions and validation are enforced at the application infrastructure level rather than relying on LLM self-policing or prompt-based restrictions. First implemented in production at alan-health for their tool-permission-systems.

Core Principle

Enforcement Layer: Tool execution permissions are validated and enforced by the application infrastructure, not the LLM:

  • Tools configured with human validation are automatically intercepted before execution
  • Agent cannot bypass the review step regardless of its output or reasoning
  • Validation logic is hardcoded in application layer, not dependent on prompt compliance

Trust Model: "We don't trust the LLM to police itself" - validation must be technically enforced, not behaviorally requested.

Implementation Pattern

Tool Configuration: Each tool includes permission level configuration:

  • Read-only tools: Execute automatically (fetching user profiles, data comparison)
  • Sensitive write tools: Require human-in-the-loop approval (sending emails, updating records)

Validation Workflow:

  1. Agent calls tool with specific arguments
  2. Application layer checks tool's configured permission level
  3. If human validation required, tool call is intercepted and queued for approval
  4. Human operator reviews arguments and approves/denies
  5. Only after approval does tool execute with provided arguments

Security Benefits

Robust Protection: Prevents agent from executing sensitive actions even if:

  • Prompt injection attempts bypass instructions
  • Model reasoning fails to follow permission guidelines
  • Agent experiences unexpected behavior or hallucinations

Audit Trail: All tool calls and human approval decisions logged for compliance and debugging.

Granular Control: Different permission levels can be applied per tool based on business risk assessment.

Production Results at Alan

Trust Building: Essential for gaining operations team confidence in AI agent deployment for real business processes.

Risk Management: Enables deployment of powerful agents with access to sensitive systems while maintaining appropriate human oversight.

First Production Use: Successfully validates pattern for enterprise AI agent deployment, likely to be adopted by other teams and use cases.

Architectural Considerations

Performance Impact: Human validation introduces latency for sensitive operations, requiring careful tool categorization.

User Experience: Operators must review and approve tool calls, requiring intuitive approval interfaces.

Scalability: As automation rates increase, human approval bottlenecks must be carefully managed through tool permission optimization.

Strategic Innovation

Industry Pattern: Represents significant advancement beyond prompt-based safety measures commonly used in AI agent systems.

Enterprise Adoption: Provides framework for deploying AI agents in regulated environments where actions have business consequences.

Platform Foundation: Enables building of comprehensive enterprise AI agent platforms with appropriate governance.

See also

Belgium Claims Processing

page dédiée →

Second use case implemented on alan-ai-agents-platform, chosen strategically to validate platform generalizability across geographic markets and operational domains. Represents alan-health's expansion into Belgium market with AI-powered claims automation including document parsing capabilities.

Strategic Selection Rationale

david-merkle and the Ops AI Agents team selected this use case deliberately to test platform boundaries:

  • New product area: Different from employment data processing
  • New country: Belgium market requiring locale-specific processing rules
  • New pattern: Document parsing integration beyond structured data processing
  • Platform validation: Perfect test case for architectural generalizability

Technical Implementation

Document Processing Integration

Unlike blocked-employment-movements which handled structured data, Belgium claims requires:

  • Multimodal document analysis: Processing scanned claims documents, receipts, medical reports
  • Text extraction and validation: OCR and intelligent parsing of varied document formats
  • Cross-language processing: Handling French, Dutch, and English language documents in Belgian context

Platform Reusability Validation

Successfully leveraged alan-ai-agents-platform components:

  • Generic AI Agent Chat Panel: Reused for claims processing interface
  • Shared backend code: Agent-business object associations for claims data
  • Agent base class: Configuration management and tool validation framework
  • Git-based configuration: Operations team autonomy for Belgium-specific rules

Geographic Expansion Impact

Global Code Development

Belgium implementation forced development of:

  • Generic, global code patterns: Rather than France-specific implementations
  • Locale-aware processing: Country-specific regulations and document formats
  • Multi-language support: Document processing across Belgian language requirements
  • Regulatory compliance: Belgian healthcare and insurance regulations integration

Platform Architecture Evolution

The expansion validated core architectural decisions:

Development Timeline and Results

Recent Implementation

  • Started "in the last weeks" as of April 2026 publication
  • Rapid deployment leveraging existing platform components
  • Early validation of document parsing integration success
  • Proof of platform's ability to handle diverse operational patterns

Expected Outcomes

While specific metrics not yet published, the implementation serves as:

  • Generalizability proof: Platform works beyond initial use case
  • International expansion enabler: Framework for additional country rollouts
  • Document processing validation: Integration of parsing capabilities with agent workflows

Platform Impact

Architecture Validation

Belgium claims processing proves alan-ai-agents-platform design principles:

  • Reusable components: Generic framework adapts to new domains
  • Configuration flexibility: Git-based approach handles country-specific requirements
  • Tool extensibility: New document processing tools integrate seamlessly
  • UI generalization: Chat panel component works across operational contexts

Future Expansion Framework

Success creates template for additional country and use case expansions:

  • Standardized deployment process: Proven methodology for new market entry
  • Component library growth: Additional tools and patterns for international deployment
  • Operational team empowerment: Local teams can customize agents for regional requirements

The Belgium claims processing implementation represents crucial validation that alan-ai-agents-platform achieves its goal of being a truly scalable, generic framework for enterprise AI agent deployment across diverse operational contexts.

See Also

Blocked Employment Movements

page dédiée →

Operational process at alan-health where incoming employment data that cannot be automatically processed due to inconsistencies requires manual investigation and resolution. Serves as the first successful use case for alan-ai-agents-platform, achieving 70% processing rate and 94% accuracy, serving as proof-of-concept for enterprise AI agent deployment.

Process Definition

Data Flow Context

When new employment data arrives from multiple sources:

  • HR admin invitations: Manual company administrator entries
  • Bulk imports: Large-scale employee data uploads
  • System integrations: Automated feeds from HR systems

Blocking Conditions

Employment movements become "blocked" when automatic processing fails due to:

  • Partial matches: Email and names match existing users but social security numbers differ
  • Data inconsistencies: Conflicting information across data sources
  • Ambiguous identities: Multiple possible matches for single employment record
  • Missing information: Required fields absent or incomplete

Manual Resolution Process

Traditional operator workflow involves:

  1. Case review: Examine blocked movement details in internal tool
  2. Scenario identification: Determine which type of inconsistency applies
  3. Data investigation: Check existing user profiles and employment history
  4. External communication: Contact HR admins when clarification needed
  5. Record updates: Modify database records to resolve inconsistencies
  6. Status management: Update movement status to processed or escalated

AI Agent Implementation

Agent Capabilities

alan-ai-agents-platform deployment includes:

  • 15 tools: Mirror complete operator workflow capabilities
  • Conversational interface: Multi-turn interaction embedded in existing tool
  • Reasoning: Natural language processing of complex scenarios
  • Decision making: Automated resolution of standard cases

Tool Categories

  • Read-only tools: User profile fetching, data comparison, history review
  • Write tools with approval: Email sending to external admins, record updates
  • Status management: Blocked movement resolution and escalation

Permission Framework

  • Automatic execution: Read-only data gathering tools
  • Human-in-the-loop: Write operations require operator approval
  • Application-layer validation: Cannot bypass security regardless of LLM behavior

Production Results

Automation Metrics

  • 70% processing rate: Agent handles majority of blocked movements
  • 25% full automation: End-to-end resolution without human intervention
  • 94% accuracy: Weekly tracking with expert operator annotations
  • 15 tools implemented: Comprehensive workflow coverage

Performance Characteristics

  • Complex reasoning: Handles edge cases like compound names ("Marie Marceau-Dupont" vs "Marie Dupont")
  • Fuzzy matching: Natural language approach to data comparison vs exhaustive rules
  • Context awareness: Considers full employment history and company relationships
  • Escalation capability: Routes unsolvable cases to human queues

Strategic Significance

Platform Validation

Chosen as first use case due to:

  • Well-defined process: Clear procedural documentation and success criteria
  • Structured outcomes: Database record modifications with measurable accuracy
  • Manageable scope: Contained workflow suitable for initial development
  • Business impact: Significant manual effort reduction opportunity

Learning Outcomes

Provided key insights for platform development:

  • Tool permission patterns: Application-layer security more reliable than LLM self-policing
  • Conversational superiority: Multi-turn interaction more flexible than single-turn structured output
  • Integration importance: Embedded UI better than standalone tools
  • Configuration management: git-based-configuration enables operations team ownership

Scaling Foundation

Success enabled platform expansion to:

  • belgium-claims-processing: Geographic and domain validation
  • Sales AI agents: Different department deployment
  • Reusable components: Generic infrastructure for rapid deployment

Technical Implementation Details

Integration Architecture

  • Embedded interface: Chat panel within existing blocked movements tool
  • Real-time updates: Agent actions immediately reflected in operator interface
  • Task orchestration: Integration with existing queue management systems
  • Escalation workflow: Seamless handoff when agent cannot resolve case

Configuration Management

  • Git-based prompts: Operations team can modify agent behavior
  • Branch testing: Safe iteration on agent configuration in staging
  • Evaluation datasets: Test cases stored alongside configuration
  • Performance tracking: Metrics correlation with configuration changes

Example Resolution Flow

  1. Case ingestion: Agent receives blocked movement details
  2. Scenario analysis: Determines partial match with existing user
  3. Data gathering: Fetches user profiles and employment history
  4. Tool execution: Compares names allowing for variation patterns
  5. Resolution decision: Determines safe automatic merge or escalation needed
  6. Action execution: Updates records with operator approval if required
  7. Status update: Marks case as resolved or escalated

Lessons Learned

Successful Patterns

  • Reasoning over rules: LLM handles unanticipated variations better than exhaustive branching
  • Permission-based security: Application layer enforcement more reliable than prompt-based restrictions
  • Embedded deployment: Integration within existing workflows reduces adoption friction
  • Iterative configuration: Operations team ownership enables continuous improvement

Implementation Challenges

  • Compound name handling: Required specific prompt instruction for name variations
  • Performance tracking: Weekly annotation overhead for accuracy measurement
  • Team transition: UX challenges when empowering operations teams with Git workflows
  • Tool complexity: 15 tools required for comprehensive workflow coverage

This case study represents one of the most successful documented implementations of AI agents for enterprise operational processes, providing practical patterns for automated decision-making with appropriate human oversight.

See also

Conversational Agents vs Structured Output

page dédiée →

Architectural decision in AI agent design between single-turn structured output systems and multi-turn conversational interfaces. alan-health found conversational agents significantly more flexible and powerful for operations automation after testing both approaches.

Single-Turn Structured Output

Characteristics:

  • Agent receives input and produces final structured result
  • No intermediate interaction or clarification possible
  • Deterministic output format
  • Simpler implementation and testing

Limitations:

  • Cannot handle ambiguous cases requiring clarification
  • No ability for operators to course-correct mid-process
  • Limited adaptability to edge cases
  • Requires comprehensive upfront specification

Conversational Agent Approach

Characteristics:

  • Multi-turn dialogue with reasoning transparency
  • Operators can send follow-up messages and corrections
  • Agent can ask clarifying questions
  • Flexible adaptation to unexpected scenarios

Advantages:

  • Course correction: Operators can guide agent when initial approach is suboptimal
  • Transparency: Reasoning steps visible throughout process
  • Flexibility: Handles edge cases through dialogue
  • Generalizability: Same conversation pattern works across different processes

Implementation at Alan

Alan's initial single-turn approach proved too rigid for complex operations scenarios. Moving to conversational agents enabled:

  • Operators to provide additional context when needed
  • Real-time guidance for ambiguous cases
  • Better operator trust through visible reasoning
  • Easier scaling to new use cases

Design Considerations

When to Choose Conversational:

  • Complex decision trees with edge cases
  • Human oversight and intervention expected
  • High-stakes actions requiring confirmation
  • Processes benefiting from human expertise input

When Structured Output Suffices:

  • Well-defined, deterministic processes
  • Batch processing scenarios
  • High-volume, low-complexity tasks
  • Systems integration requiring specific formats

The conversational approach trades implementation complexity for operational flexibility and human-AI collaboration effectiveness.

See also

Embedded UI Integration

page dédiée →

UI design pattern for AI agents where agent interfaces are embedded directly within existing operational tools rather than requiring separate standalone applications. Successfully implemented at alan-health to maintain operator workflow continuity while adding AI capabilities.

Core Philosophy

Workflow Preservation: Operators continue using familiar internal interfaces they already know. AI assistance appears as additional capability within existing tools rather than requiring workflow disruption.

Context Continuity: Agent actions and results (like updating blocked movement status) immediately reflect in the same interface where operators were already working. No context switching between tools required.

Technical Implementation

Generic Chat Panel: Reusable frontend component that can be integrated into any internal tool with minimal effort. Displays agent reasoning, tool calls, and approval workflows consistently across applications.

Business Object Association: Shared backend code for linking agent conversations with arbitrary business objects (blocked movements, claims, user profiles). Enables agent context to persist with relevant operational data.

Tool Result Integration: Agent actions like database updates or status changes immediately appear in the host interface. Operators see real-time effects of approved agent tools within their existing workspace.

Benefits

Reduced Learning Curve: Operators don't need training on new interfaces. AI capabilities appear as natural extensions of tools they already use daily.

Trust Building: Seeing agent reasoning and tool calls within familiar contexts builds operator confidence. The AI feels like an assistant rather than a replacement.

Reusable Scaling: Generic components enable rapid deployment across different operational areas without rebuilding integration layer for each use case.

Implementation at Alan

Embedded within existing blocked employment movements tool. Operators open cases in their normal interface, then launch AI analysis that opens chat panel within the same tool. Agent actions immediately update the underlying case data visible in the main interface.

Successfully expanded to Sales AI agent in different internal tool, demonstrating reusability of the approach across operational domains.

See also

Git-Based Configuration

page dédiée →

Architectural pattern for AI agent systems where prompts, tool configurations, and evaluation datasets are stored and managed in Git repositories rather than databases or file storage. Pioneered by david-merkle at alan-health for operations-team-autonomy in agent development, enabling domain experts to iterate on agent behavior without engineering support.

Core Benefits

Version Control Features

  • Complete history: Track every change to prompts and configurations
  • Branching: Safe testing environment for modifications without affecting production
  • Pull requests: Peer review workflow between operations team members
  • Diffs: Visual comparison of exactly what changed and when
  • Audit trail: Full traceability of who changed what and why for compliance

Developer Experience

  • Familiar tooling: Leverages existing Git workflow knowledge
  • No custom UI needed: Uses GitHub's existing editing and review interfaces
  • Branch-based testing: Load any configuration branch in staging environment
  • Immediate deployment: No build or deployment pipeline required
  • Rollback capability: Instant reversion to previous configurations

Implementation at Alan

Storage Architecture

All agent configuration stored in Git repositories:

  • Prompts: System and user prompt templates with variables
  • Tool configuration: Permission levels and parameter definitions
  • Evaluation datasets: Test cases and expected outcomes for agent validation
  • Documentation: Process descriptions and troubleshooting guides

Operations Team Workflow

  1. Edit configuration: Direct GitHub file editing or local development
  2. Create branch: Isolated environment for testing changes
  3. Test in staging: Specify branch name in Agent Panel UI for immediate testing
  4. Validate results: Run agent on staging blocked movements or test cases
  5. Peer review: Open pull request for operations team review
  6. Deploy: Merge to main branch for production deployment

Example Use Case

When blocked-employment-movements agent failed on compound names:

  • Operations team member identified pattern failure
  • Added prompt instruction for name variation handling
  • Created branch with modified configuration
  • Tested on staging environment with compound name cases
  • Verified fix resolved the issue
  • Opened PR for peer review and merged to production

Technical Implementation

Configuration Loading

  • Production: Always loads from main branch
  • Staging/Development: Can specify any branch via UI parameter
  • Hot reloading: Changes take effect immediately without restart
  • Fallback mechanism: Default to main branch if branch not found

Security Considerations

  • Access control: Repository permissions control who can modify agents
  • Review requirements: Pull request process ensures peer validation
  • Audit logging: Git history provides complete change tracking
  • Secrets management: Sensitive data stored separately from configuration

Advantages Over Alternatives

vs Database Configuration

  • Version control: Native branching and merging capabilities
  • Audit trail: Complete change history with commit messages
  • Collaboration: Pull request workflow for team coordination
  • Backup: Distributed storage across all team members
  • No schema migrations: Text files evolve without database changes

vs File Storage (S3, etc.)

  • Collaboration: Multi-user editing with conflict resolution
  • History: Complete change tracking with diff visualization
  • Branching: Parallel development and testing capability
  • Access control: Fine-grained permissions via repository settings
  • Integration: Works with existing developer workflows

Current Limitations and Solutions

UX Challenges

  • Technical barrier: YAML and Git workflows unnatural for operations teams
  • Slower iteration: Reduced pace since empowering operations teams
  • Learning curve: Non-technical users need Git workflow training

Solutions in Development

  • Enhanced UI: Building friendlier interface layer over GitHub
  • meta-agents: Exploring agents that can modify other agents' configurations
  • Visual editors: WYSIWYG interfaces for prompt and configuration editing
  • Simplified workflows: One-click testing and deployment options

Industry Impact

Pioneering Approach

First documented use of Git as primary storage for AI agent configuration at enterprise scale, demonstrating:

  • Team autonomy: Non-technical teams can own agent development
  • Governance: Audit and compliance requirements met through Git workflows
  • Scaling: Platform approach enables rapid deployment across use cases
  • Collaboration: Cross-functional teams can contribute to agent development

Adoption Considerations

Suitable for organizations with:

  • Multiple agents: Platform approach justifies infrastructure investment
  • Team ownership: Domain experts want to iterate on agent behavior
  • Compliance requirements: Audit trail and approval workflows needed
  • Technical literacy: Teams comfortable with basic Git workflows or willing to learn

Future Evolution

Meta-Agents Integration

Exploring how meta-agents can interact with Git-based configuration:

  • Automated commits: Agents proposing configuration changes via PR
  • Performance-driven iteration: Agents optimizing prompts based on metrics
  • Test generation: Agents creating evaluation datasets for configuration changes
  • Documentation: Agents updating process documentation alongside configuration

Platform Maturity

Expected evolution of the pattern:

  • Visual interfaces: GUI layers over Git storage for non-technical users
  • Integration APIs: Programmatic access to configuration management
  • Analytics: Usage tracking and performance correlation with configuration changes
  • Multi-repository: Complex agents spanning multiple configuration repositories

See also

Human-in-the-Loop Systems

page dédiée →

AI system architecture pattern where humans provide oversight, approval, or intervention at critical decision points. Essential for enterprise AI deployments where full automation carries business risk or requires compliance oversight. Successfully implemented across multiple production systems at alan-health.

Core Principles

Risk-Based Automation

  • Automatic execution for low-risk, read-only operations
  • Human approval gates for sensitive actions with business consequences
  • Application-layer enforcement preventing AI bypass of approval workflows
  • Graduated permission levels based on action criticality

Trust Building Strategy

  • Transparent reasoning showing AI decision-making process
  • Approval interfaces with clear action context and consequences
  • Conversation continuity allowing human course-correction
  • Audit trails tracking all approvals and interventions

Implementation Patterns

Tool-Level Permissions

At alan-ai-agents-platform:

  • Read-only tools (user profile fetching) execute automatically
  • Write tools (email sending, record updates) require human approval
  • Permission configuration per tool type and business impact
  • Operator review of tool arguments before execution

Document Processing Workflows

In Alan's document processing pipeline:

  • Automated classification and data extraction for standard documents
  • Human review queues for edge cases and low-confidence predictions
  • Expert validation for critical healthcare document processing
  • Feedback loops improving model performance through human corrections

Architecture Components

Approval Workflow Design

AI Agent Decision → Risk Assessment → Permission Check → 
  ├── Low Risk: Auto-Execute
  └── High Risk: Human Approval → Execute/Reject

Interface Integration

  • Embedded approval panels within existing operational tools
  • Context-rich displays showing agent reasoning and proposed actions
  • One-click approval/denial with optional feedback mechanisms
  • Real-time updates reflecting approved actions in operational systems

Production Results

Alan AI Agents Platform

  • 70% automation rate with selective human oversight
  • 94% accuracy maintained through approval workflows
  • 25% full end-to-end automation for routine cases
  • Zero bypass incidents due to application-layer enforcement

Document Processing Pipeline

  • Significant automation rates while maintaining quality standards
  • Edge case handling through expert human review
  • Continuous improvement through human feedback integration

Design Considerations

Trust and Adoption

  • Gradual autonomy increase as confidence builds
  • Operator control over automation level and approval thresholds
  • Clear escalation paths for complex cases
  • Performance visibility showing human vs. automated outcomes

Operational Efficiency

  • Minimal approval friction for routine operations
  • Batch approval capabilities for similar actions
  • Queue management preventing approval bottlenecks
  • Time-based escalation for urgent approvals

Security and Compliance

  • Multi-layer validation preventing unauthorized actions
  • Complete audit trails for regulatory compliance
  • Role-based permissions controlling approval authority
  • Fallback procedures when human oversight unavailable

Success Factors

Technology Integration

  • Seamless embedding in existing workflows rather than standalone tools
  • Real-time synchronization between AI actions and operational systems
  • Robust permission enforcement at the application layer
  • Clear action boundaries between automated and manual processes

Organizational Change Management

  • Operator training on AI capabilities and limitations
  • Gradual rollout building confidence through success
  • Feedback collection for continuous improvement
  • Change advocacy from operations team members

See also

Long-Tail Operations Automation

page dédiée →

Business challenge where numerous small-to-medium operational processes, individually costing only dozens of hours monthly, accumulate to represent millions of euros annually in manual effort. Traditional automation approaches focus on high-volume processes, leaving the "long tail" manual.

The Problem

Characteristics of Long-Tail Processes:

  • Hundreds of distinct processes per organization
  • Each process: dozens of hours monthly individual cost
  • Accumulated cost: millions annually across all processes
  • Involves ambiguity, edge cases, judgment calls
  • Traditional approach: document → train → hire more people

Why Traditional Automation Fails:

  • Each process too small for dedicated product team
  • Rule-based systems cannot handle edge cases effectively
  • Development cost exceeds individual process value
  • Requires anticipating every variation upfront

AI Agent Solution

Platform Approach Benefits:

  • Single platform serves multiple processes
  • Reasoning handles edge cases without exhaustive rules
  • Operations teams can iterate without engineering support
  • Incremental rollout across process portfolio

Key Enablers:

Alan's Implementation

Results Across Process Portfolio:

  • Blocked employment movements: 70% automation rate
  • Belgium claims processing: second successful deployment
  • Reusable platform components enable rapid expansion
  • Operations teams iterate independently on agent behavior

Scaling Strategy:

  • Target 80% automation across operations processes
  • Engineering focuses on platform enhancement
  • Operations teams own individual agent optimization
  • Platform approach makes long-tail economically viable

Strategic Implications

Business Impact:

  • Transforms previously uneconomical automation targets
  • Compounds efficiency gains across numerous processes
  • Reduces hiring pressure as business scales
  • Enables operations teams to focus on complex cases

Competitive Advantage:

  • Creates operational leverage unavailable to competitors
  • Builds institutional knowledge into automated systems
  • Scales domain expertise through AI rather than hiring

This represents a fundamental shift from automating individual high-volume processes to systematically addressing the accumulated cost of manual operations across an entire organization.

See also

Emerging AI system architecture where agents can modify other agents' configurations, prompts, and evaluation datasets. Explored by alan-health as a solution to improve user experience for operations teams while maintaining the benefits of git-based-configuration.

Core Concept

Definition: Agents that operate at a higher abstraction level, capable of:

  • Modifying agent prompts and instructions
  • Updating tool configurations and permissions
  • Generating and maintaining evaluation datasets
  • Orchestrating testing and validation workflows

Motivation: Bridge the gap between technical Git-based workflows and operations team usability needs while preserving version control and audit benefits.

Potential Applications

Configuration Management: Meta-agents could interpret natural language requests from operations teams and translate them into appropriate Git configuration changes.

Evaluation Enhancement: Automatically generate test cases based on production failure patterns or edge cases discovered during agent operation.

Performance Optimization: Analyze agent conversation logs to identify improvement opportunities and propose configuration adjustments.

Implementation Challenges

Validation Complexity: Meta-agents modifying other agents introduces additional layers of validation and potential failure modes.

Change Management: Maintaining human oversight and approval workflows becomes more complex with automated configuration changes.

Testing Requirements: Meta-agent changes require comprehensive testing frameworks to prevent cascade failures across multiple operational processes.

Strategic Value

Scaling Operations Team Autonomy: Could enable operations teams to request agent improvements in natural language while maintaining technical rigor of Git-based workflows.

Continuous Improvement: Automated iteration on agent performance based on production feedback and failure analysis.

Knowledge Transfer: Meta-agents could encode domain expert knowledge about agent configuration patterns for reuse across teams.

Current Status at Alan

Exploration Phase: Mentioned as prototyping approach alongside UI improvements for Git-based configuration workflow.

Integration with Testing: Expected to be covered in dedicated article on testing, evaluation, and meta-agents from alan-health team.

See also

Operations Team Autonomy

page dédiée →

Design philosophy and architectural pattern where non-technical operations teams can iterate on AI agent behavior independently without requiring engineering support. Successfully implemented at alan-health using git-based-configuration to enable operations staff to modify prompts, tool configurations, and evaluation datasets directly.

Core Philosophy

The fundamental principle is that every prompt tweak or new scenario shouldn't require an engineer. For AI agent platforms to scale across dozens of operational processes, domain experts must be empowered to refine agent behavior based on their operational knowledge.

Implementation Approach

Git-Based Workflow

  • Agent prompts, tool configurations, and evaluation datasets stored in Git repositories
  • Operations team members create branches for testing modifications
  • Staging environment supports testing any branch configuration
  • Pull request workflow enables peer review between operations team members
  • Full audit trail of changes with diff visibility

Benefits Achieved

  • Version Control: Complete history of all agent modifications
  • Safe Testing: Branch-based approach prevents production impacts
  • Peer Review: Operations team members review each other's changes
  • Traceability: Full audit trail essential for systems taking real actions
  • Rapid Iteration: No deployment pipeline or local setup required

Challenges and Trade-offs

Current implementation relies on basic GitHub interface (file editing, branches, YAML) which is unnatural for operations teams. This has slowed iteration pace compared to engineering-driven development, but provides solid foundations for scaling to multiple agent use cases.

Future Evolution

alan-health is exploring "meta-agent" approaches and improved UIs built on top of Git to maintain the architectural benefits while improving user experience for operations teams.

See also

Reusable Agent Components

page dédiée →

Architectural approach for building AI agent platforms using shared, modular components that can be rapidly deployed across different use cases and teams. Successfully implemented at alan-health to enable quick bootstrapping of new agents for operations, sales, and other internal functions.

Core Components

Frontend Components

  • Generic AI Agent Chat Panel: Embeddable component that integrates into any internal tool with minimal effort
  • Conversation Interface: Standardized UI for agent interaction and tool call approval
  • Tool Call Visualization: Consistent display of agent actions and approval workflows

Backend Infrastructure

  • Agent Base Class: Handles branching logic for Git-based configuration loading
  • Conversation Management: Associates agent conversations with arbitrary business objects
  • Tool Call Validation: Application-layer enforcement of human-in-the-loop requirements
  • Queue Integration: Standardized task orchestration platform connectivity

Shared Runtime

  • Python Framework: Common runtime environment used across multiple AI products at Alan
  • Configuration Loading: Dynamic loading of agent config from remote Git branches
  • Permission System: Configurable tool-level access controls

Validation Through Scale

The reusable approach proved successful through rapid expansion:

  • Belgium Claims: Second use case deployment to validate generalizability
  • Sales AI Agent: Sister team deployment into different internal tool
  • Multiple Products: Shared across Mo (medical assistant), Automated Resolution, and operations agents

Strategic Benefits

  • Rapid Deployment: New agents can be bootstrapped quickly with proven components
  • Consistent UX: Standardized interaction patterns across all internal tools
  • Reduced Engineering Overhead: Focus shifts from individual agent development to platform enhancement
  • Cross-Team Efficiency: Teams can leverage shared infrastructure without rebuilding core functionality

Design Principles

  1. Modularity: Components can be mixed and matched for different use cases
  2. Embeddability: Agents integrate into existing workflows rather than requiring new tools
  3. Configuration-Driven: Behavior changes through configuration, not code modifications
  4. Platform-First: Individual agents consume platform services rather than implementing custom logic

See also

Shared Agent Framework

page dédiée →

Python-based agent runtime and framework at alan-health that powers multiple AI products including Mo (personalized medical assistant), automated support resolution, and operations agents. Enables rapid deployment of new conversational AI agents across different domains through reusable infrastructure components.

Architecture Components

Agent Base Class: Handles branching logic for loading agent configuration from remote Git branches, tool call validation workflows, and human-in-the-loop approval patterns.

Conversation Management: Shared backend code for associating agent conversations with arbitrary business objects, enabling integration across different operational contexts.

Tool Integration: Standardized tool calling interface with configurable permission levels and validation workflows, supporting both read-only automatic execution and write operations requiring human approval.

Runtime Environment: Production-ready Python runtime handling agent execution, state management, and integration with existing internal systems and databases.

Reusability Benefits

Rapid Bootstrap: New agent development reduced from weeks to days through shared infrastructure, demonstrated by quick deployment of Belgium claims agent and sister team's sales AI agent.

Consistent Patterns: Standardized approaches to common agent needs (conversation state, tool permissions, human-in-the-loop workflows) reducing cognitive overhead and maintenance complexity.

Cross-Team Enablement: Platform provides sufficient abstraction for other teams to deploy their own agents without deep AI engineering expertise, as demonstrated by sales team adoption.

Quality Inheritance: New agents inherit battle-tested patterns for security, reliability, and operational integration developed through production use across multiple domains.

Framework Features

Branch-Based Configuration: Integration with git-based-configuration allowing agents to load prompts and tool configurations from any Git branch for testing and iteration.

Permission Validation: Application-layer enforcement of tool permissions preventing bypass of human approval workflows, essential for enterprise deployment trust.

Generic UI Components: Reusable chat panel components that integrate into any internal tool with minimal engineering effort, maintaining consistent user experience.

Task Orchestration: Integration with existing workflow management systems allowing agents to process queued tasks and escalate appropriately.

Production Validation

Framework has demonstrated reliability across diverse use cases:

  • Mo: Personalized medical assistant requiring high accuracy and safety
  • Support Automation: Customer-facing automated resolution requiring tone and accuracy
  • Operations Agents: Internal tools requiring database modifications and external communications
  • Sales AI: Revenue-impacting interactions requiring business context

This diversity validates the framework's generalizability and robustness across different AI agent requirements and operational contexts.

Development Acceleration

The shared framework significantly accelerated Alan's AI agent development, with David Mercklé noting that reusing the internal framework combined with AI coding tools (while maintaining architectural discipline) enabled faster-than-expected deployment of the operations agent platform.

See also

Task Orchestration Platform

page dédiée →

Workflow management system at alan-health that enables AI agents to integrate seamlessly with existing operational processes through queue-based task processing and escalation workflows.

Core Architecture

Queue-Based Processing: Agents pull tasks from operational queues, maintaining consistency with human agent workflows.

Task Lifecycle Management:

  • Agents process tasks according to defined workflows
  • Mark completed tasks automatically
  • Escalate unresolvable cases to human queues
  • Maintain audit trail of all task state changes

Integration with AI Agents

Unified Workflow: AI agents fit into the same operational workflow as human agents, ensuring:

  • Consistent task prioritization
  • Seamless handoff between AI and human processing
  • Standardized escalation procedures
  • Unified monitoring and reporting

Production Integration: Enables alan-ai-agents-platform agents to operate in production environment with proper task management and oversight.

Operational Benefits

Scalability: Allows mixing of AI and human agents based on:

  • Task complexity and agent capabilities
  • Available human operator capacity
  • Risk tolerance for specific process types

Monitoring: Centralized visibility into task processing across both AI and human agents.

Reliability: Built-in escalation ensures no tasks are lost when agents cannot complete processing.

Strategic Importance

Production Readiness: Critical component enabling enterprise-scale deployment of AI agents in operational processes.

Human-AI Collaboration: Facilitates smooth collaboration between AI agents and human operators rather than replacement model.

Scalable Operations: Foundation for scaling AI automation while maintaining operational reliability and oversight.

See also

Tool Permission Systems

page dédiée →

Security architecture pattern for AI agents that controls tool execution through permission hierarchies rather than relying on LLM self-policing. Essential for enterprise deployments where agents take actions with business consequences. Successfully implemented by alan-health as the first production use case of this pattern.

Core Principle

Application-layer enforcement: Validation occurs at the system level, not through LLM instructions. Agents cannot bypass approval workflows regardless of prompt injection or model behavior.

Permission Hierarchy

Read-Only Tools (Automatic Execution)

Tools with no business risk execute immediately:

  • Fetching user profiles
  • Comparing data records
  • Reading system status
  • Querying databases for information

Write Tools (Human-in-the-Loop Required)

High-risk tools require operator approval before execution:

  • Sending emails to external contacts
  • Updating database records
  • Triggering downstream processes
  • Financial transactions
  • Customer communications

Implementation Architecture

Approval Workflow

  1. Tool call initiated: Agent requests action with specific parameters
  2. Permission check: System validates tool configuration and required approval level
  3. Human review: Operator sees tool call details and can approve/deny
  4. Execution gate: Tool only executes after explicit human approval
  5. Audit trail: All approvals/denials logged with timestamps and reasoning

Configuration Management

Tool permissions stored in git-based-configuration, enabling:

  • Version control of permission changes
  • Peer review through pull requests
  • Rollback capability for permission modifications
  • Audit history of all permission updates

Enterprise Benefits

Trust Building

Enables operations teams to adopt AI agents with confidence, knowing that sensitive actions require human validation.

Compliance Alignment

Meets regulatory requirements for human oversight in financial services, healthcare, and other regulated industries.

Risk Management

Granular control over agent capabilities allows gradual expansion of automation while maintaining safety boundaries.

Operational Flexibility

Permissions can be adjusted based on:

  • User role and experience level
  • Business context and criticality
  • Time of day or operational mode
  • Process maturity and confidence

Production Results at Alan

Implemented across 15 specialized tools in the blocked-employment-movements process:

  • 94% accuracy maintained through appropriate human oversight
  • Zero permission bypass incidents despite extensive agent usage
  • Rapid trust adoption by operations teams due to transparent control

Scaling Considerations

Configuration Complexity

As agent platforms expand to multiple use cases, permission management becomes critical operational overhead requiring:

  • Clear permission taxonomy
  • Role-based permission templates
  • Automated compliance checking

Performance Impact

Human-in-the-loop workflows introduce latency that must be balanced against:

  • Business process SLAs
  • Operator availability and workload
  • Automation benefits vs. approval overhead

Architectural Evolution

Alan's implementation demonstrates path toward more sophisticated permission systems:

  • Meta-agent evaluation: Automated assessment of tool call safety
  • Dynamic permissions: Context-aware permission adjustment
  • Batch approval workflows: Bulk approval for similar actions

This pattern represents fundamental shift from "trust the LLM" to "trust the system architecture" in enterprise AI deployment.

See also