orka.orchestrator.path_scoring module

Path Scoring System

Multi-criteria scoring system for evaluating candidate paths. Combines LLM evaluation, heuristics, historical priors, and budget considerations.

class orka.orchestrator.path_scoring.PathScorer(config: Any)

Bases: object

Multi-criteria path scoring system.

Evaluates candidate paths using: - LLM relevance assessment - Heuristic matching (capabilities, constraints) - Historical success priors - Cost and latency penalties - Safety risk assessment

__init__(config: Any)

Initialize path scorer with configuration.

async score_candidates(candidates: List[Dict[str, Any]], question: str, context: Dict[str, Any]) → List[Dict[str, Any]]

Score all candidates using multi-criteria evaluation.

Parameters:

• candidates – List of candidate paths to score

• question – The question/query being routed

• context – Execution context

Returns:

List of candidates with scores and components