gepa

gepa-aiMIT活跃维护 有专家点评

用遗传算法和进化式迭代自动优化提示词、代码与 Agent 配置,让 LLM 反复自我反思改进,省去手工调参。

Optimize prompts, code, and more with AI-powered Reflective Optimization

v0.1.4发布于 2026-07-15 14:50 UTC7,376star +44 / 7 天616fork同步于 2026-11-11 05:31 UTC

专家点评

上手难度:进阶更新于 2026-11-11

用 LLM 反思加 Pareto 进化搜索,把提示词和 Agent 架构当可优化参数来迭代

适用场景

  • 离线批量优化提示词:你有一批带标注的评测样本,想从手写 prompt 迭代到更优版本,它把 rollout、反思、变异、Pareto 筛选串成闭环,比人工改 prompt 省去反复试错
  • 多目标权衡场景:不同任务子集上表现各有优劣的候选需要同时保留,Pareto 前沿比单一标量分数更贴近真实取舍,避免优化出一个平均分高但某类任务崩掉的 prompt
  • 优化非 prompt 文本产物:配置、代码片段、SVG 等任意文本参数走 optimize_anything,比专门写一套搜索脚本省事
  • 已有 DSPy/LangChain/RAG 管线想加一层自动调优:通过 GEPAAdapter 接入,不用重写现有调用链

踩坑

  • 成本不可控:每次迭代都要跑完整 rollout 加反思调用,任务与反思都走外部 LLM API,样本集大或迭代轮数多时 token 消耗会快速累积;issue 里有 token budget awareness 的诉求,说明当前对 prompt 体积和预算的约束并不内建
  • 长跑中断恢复:issue 里 Restart from log_dir not working 和避免重复 rollout 的诉求同时出现,说明断点续跑和缓存复用这块还不稳,长时间优化任务要做好重跑的心理准备
  • 适配器依赖分散:ConfidenceAdapter、LangChain 等要装 gepa[confidence]、gepa[langchain] 可选依赖,Agent Skill 方式还要求在克隆目录或 plugin marketplace 安装后才能被编码 Agent 发现,装完 pip install gepa 不等于能用全部功能

同类对比

DSPy 的 optimizer 系列(BootstrapFewShot、MIPROv2)在纯 prompt 优化上更成熟、生态更完整;如果只需要单轮 few-shot 自动构造而不需要进化搜索和 Pareto 多目标,选 DSPy 更轻。

怎么上手

由 README 提炼,执行前请确认
pip install gepa
硬件要求按 README 说明

README 未说明;任务与反思均调用外部 LLM API(如 openai/gpt-4.1-mini、openai/gpt-5),本地无需 GPU 显存

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

用 LLM 反思加 Pareto 进化搜索,自动优化提示词、代码和 Agent 架构等文本参数

用遗传算法和进化式迭代自动优化提示词、代码与 Agent 配置,让 LLM 反复自我反思改进,省去手工调参。

核心能力

  • 让 LLM 读取完整执行轨迹诊断失败原因并定向变异
  • 用 Pareto 前沿保留在不同任务子集上各有所长的候选
  • 支持系统感知合并,融合两个 Pareto 最优候选的优势
  • 通过 GEPAAdapter 接口接入任意系统,内置 DSPy、RAG、LangChain 等适配器
  • optimize_anything API 可优化代码、配置、SVG 等任意文本产物

容易踩的坑

需要自备 LLM API 与密钥,示例默认使用 openai/ 前缀模型;ConfidenceAdapter、LangChain 等适配器需额外安装可选依赖(如 gepa[confidence]、gepa[langchain]);Agent Skill 方式需在仓库克隆目录或通过 /plugin marketplace 安装后才能被编码 Agent 发现

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本v0.1.4
  1. v0.1.4最新正式版2026-07-15 · 2026-07-15 14:50 UTC

    This release ships the reflection-LM protocol and batch-based parallel proposals ([RFC #329](https://github.com/gepa-ai/gepa/issues/329), Phases 1 & 4) — the largest change to GEPA's proposal machinery since the project started, contributed by @Benzhang2004 in #369 and hardened through five review rounds. One breaking change is called out under Breaking & upgrade notes.

    pip install -U gepa
    

    Highlights

    • Multi-proposal iterations via composable strategies (#369): each iteration can now sample and evaluate many candidate proposals instead of one. sampling_strategy= chooses the (parent, minibatch) tasks — SingleMutationSampling (default, classic GEPA), SameParentSampling(n), IndependentSampling(n), PxNSampling(p, n) — and selection_strategy= decides which improvements enter the pool: AllImprovements (default), BestImprovement, TopKImprovements(k). Defaults reproduce previous behavior exactly (pinned by replay tests against a recorded pre-change run). Full guide: [Parallel Proposals](https://gepa-ai.github.io/gepa/guides/parallel-proposals/).
    • The ReflectionLM protocol + reflection_strategy= (#369, RFC #329 Phase 1): the reflection step is now a seam. Pass a custom ReflectionLM implementation to gepa.optimize(reflection_strategy=...) or ReflectionConfig(reflection_strategy=...) to own how reflective mutation calls the reflection model — the entry point for session-based, aggregating (ComBEE-style, #307), and coding-agent reflectors. Stateful implementations return a successor from reflect(); chaining semantics are documented in [RFC #329](https://github.com/gepa-ai/gepa/issues/329#issuecomment-4981863763). Multi-call reflectors get a ReflectionProposal.metadata diagnostics channel that flows through to callbacks, trackers, and proposal metadata.
    • batch_evaluator= — one external call for all pending evaluations (optimize_anything): hand GEPA a function that receives every pending (candidate, example) pair in a single call (provider batch APIs, Slurm/Ray, your own cluster) and return one result per pair. Parity with the standard evaluator path: shared evaluation caching (only misses reach your function, still as one call), per-pair opt_states warm-start injection, raise_on_exception policy with a documented _gepa_transient_failure contract (failures are never cached), str-candidate unwrapping, and identical output packaging. evaluator= is now optional when batch_evaluator= is provided — everything routes through your batch function, including refiner steps as singleton batches.
    • Adapters can batch: the optional GEPAAdapter.batch_evaluate seam lets adapters parallelize multi-proposal evaluations however they like; adapters that only implement evaluate() keep working unchanged (sequential fallback).
    • Selection is the authority, and rejection reasons are truthful: selection strategies receive all evaluated proposals plus the acceptance criterion (built-ins filter; custom strategies may deliberately surface criterion-rejected proposals). Everything unselected fires on_candidate_rejected with an accurate reason — acceptance failure, dropped-by-selection, or duplicate — and acceptance criteria may provide a reject_reason(proposal, state) hook for custom messages. Criteria are judged exactly once per proposal (memoized), so stateful or stochastic criteria behave correctly. Identical child candidates within an iteration are deduplicated before valset evaluation.
    • Per-task run traces: full_program_trace entries now record every task in multi-task iterations (n_tasks, tasks with per-task ids and before/after scores) and every accepted program index (new_program_indices); each proposal carries a stable metadata["proposal_id"]. Legacy
  2. v0.1.32026-07-14 · 2026-07-14 13:10 UTC
    查看更新说明

    This release ships everything merged to main since v0.1.1 (March 2026): two new adapters, parallel proposal generation, reflection-cost controls, a unified LM layer, dependency security bumps, and a large expansion of the docs and showcase.

    pip install -U gepa
    

    Highlights

    • LangChain adapter — optimize LangChain/LangGraph applications directly with gepa.optimize (#361, @bryonkucharski). Install with pip install 'gepa[langchain]'.
    • ConfidenceAdapter — logprob-aware scoring and reflection for classification tasks (#258, @rodolfo-nobrega). Install with pip install 'gepa[confidence]'.
    • Reflection-cost controls — new max_reflection_cost budget knob, with cost/token tracking moved into a unified LM layer (#327, #325); pass provider-specific parameters to the reflection model via reflection_lm_kwargs (#336).
    • Unified LM layer with reasoning-model support — first-class handling of reasoning models as reflection LMs (#253).
    • Callbacks in optimize_anything — the GEPACallback protocol now works in optimize_anything runs, not just gepa.optimize (#290).
    • Embed GEPA in your own training loop — wandb_attach_existing / mlflow_attach_existing log into an already-active run without GEPA managing its lifecycle (#280), and reflection prompts/outputs are logged to a proposals table for run archaeology (#276, #254).
    • Pluggable acceptance criterion — choose "strict_improvement" or "improvement_or_equal", or pass your own AcceptanceCriterion (#304).
    • Adapter-specific persistence — adapters can now store state in GEPAState.adapter_state so custom adapters survive checkpoint/resume (#230, @lukedhlee).
    • Dynamic datasets — trainset_loader exposed in IterationStartEvent for datasets that change during optimization (#247).

    Fixes

    • Corrected broken code snippets in the quickstart and FAQ (#347).
    • DspyAdapter: fixed a crash on outputs=None and a reflection_lm type mismatch (#320, @Archelunch).
    • Refiner evaluator calls are now correctly counted toward the metric-call budget (#315, @Shangyint).
    • Security: bumped litellm, mlflow, and requests floors to address Dependabot alerts (#322). If you install gepa[full], this raises the litellm floor to ≥1.83.

    Upgrade notes

    • track_best_outputs now defaults to True (#286). Best outputs are retained on the result object by default, which is what most users expect when inspecting results — but it increases memory use for large valsets. Pass track_best_outputs=False to restore the old behavior, especially if you embed GEPA inside a training loop.
    • State schema v4 → v5. Run directories written by v0.1.1 are migrated automatically on load; resuming an existing run_dir with v0.1.2 is supported. Note that a state written by v0.1.2 is not designed to be loaded by v0.1.1 — finish in-flight runs on the version that started them, or upgrade before resuming.
    • Python 3.14 dependency handling in the full extra was restructured (#322 and packaging cleanups); if you previously pinned workarounds for 3.14, they should no longer be necessary.

    Experimental

    • Parallel proposals (#314, @Shangyint): optimize_anything can generate and evaluate multiple candidate proposals per iteration via EngineConfig.num_parallel_proposals. This interface is experimental and will change: per RFC #329, the next minor release replaces the integer knob with composable sampling/selection strategies (see #369), with a deprecation shim for one release. Use it, but don't build durable config around the parameter name.

    Known issues

    • In optimize_anything runs, merge-proposal events do not yet fire GEPACallback hooks (the callback plumbing from #290 does not reach the merge proposer). Mutation/iteration events are unaffected. A fix is queued for the next release.

    Docs & showcase

    • New guides: batch sampling (#335), candidate selection strategies (#30
  3. v0.1.22026-07-14 · 2026-07-14 12:04 UTC
    查看更新说明

    This release ships everything merged to main since v0.1.1 (March 2026): two new adapters, parallel proposal generation, reflection-cost controls, a unified LM layer, dependency security bumps, and a large expansion of the docs and showcase.

    pip install -U gepa
    

    Highlights

    • LangChain adapter — optimize LangChain/LangGraph applications directly with gepa.optimize (#361, @bryonkucharski). Install with pip install 'gepa[langchain]'.
    • ConfidenceAdapter — logprob-aware scoring and reflection for classification tasks (#258, @rodolfo-nobrega). Install with pip install 'gepa[confidence]'.
    • Reflection-cost controls — new max_reflection_cost budget knob, with cost/token tracking moved into a unified LM layer (#327, #325); pass provider-specific parameters to the reflection model via reflection_lm_kwargs (#336).
    • Unified LM layer with reasoning-model support — first-class handling of reasoning models as reflection LMs (#253).
    • Callbacks in optimize_anything — the GEPACallback protocol now works in optimize_anything runs, not just gepa.optimize (#290).
    • Embed GEPA in your own training loop — wandb_attach_existing / mlflow_attach_existing log into an already-active run without GEPA managing its lifecycle (#280), and reflection prompts/outputs are logged to a proposals table for run archaeology (#276, #254).
    • Pluggable acceptance criterion — choose "strict_improvement" or "improvement_or_equal", or pass your own AcceptanceCriterion (#304).
    • Adapter-specific persistence — adapters can now store state in GEPAState.adapter_state so custom adapters survive checkpoint/resume (#230, @lukedhlee).
    • Dynamic datasets — trainset_loader exposed in IterationStartEvent for datasets that change during optimization (#247).

    Fixes

    • Corrected broken code snippets in the quickstart and FAQ (#347).
    • DspyAdapter: fixed a crash on outputs=None and a reflection_lm type mismatch (#320, @Archelunch).
    • Refiner evaluator calls are now correctly counted toward the metric-call budget (#315, @Shangyint).
    • Security: bumped litellm, mlflow, and requests floors to address Dependabot alerts (#322). If you install gepa[full], this raises the litellm floor to ≥1.83.

    Upgrade notes

    • track_best_outputs now defaults to True (#286). Best outputs are retained on the result object by default, which is what most users expect when inspecting results — but it increases memory use for large valsets. Pass track_best_outputs=False to restore the old behavior, especially if you embed GEPA inside a training loop.
    • State schema v4 → v5. Run directories written by v0.1.1 are migrated automatically on load; resuming an existing run_dir with v0.1.2 is supported. Note that a state written by v0.1.2 is not designed to be loaded by v0.1.1 — finish in-flight runs on the version that started them, or upgrade before resuming.
    • Python 3.14 dependency handling in the full extra was restructured (#322 and packaging cleanups); if you previously pinned workarounds for 3.14, they should no longer be necessary.

    Experimental

    • Parallel proposals (#314, @Shangyint): optimize_anything can generate and evaluate multiple candidate proposals per iteration via EngineConfig.num_parallel_proposals. This interface is experimental and will change: per RFC #329, the next minor release replaces the integer knob with composable sampling/selection strategies (see #369), with a deprecation shim for one release. Use it, but don't build durable config around the parameter name.

    Known issues

    • In optimize_anything runs, merge-proposal events do not yet fire GEPACallback hooks (the callback plumbing from #290 does not reach the merge proposer). Mutation/iteration events are unaffected. A fix is queued for the next release.

    Docs & showcase

    • New guides: batch sampling (#335), candidate selection strategies (#30
  4. v0.1.12026-03-16 · 2026-03-16 10:15 UTC
    查看更新说明

    Highlights

    Candidate Tree Visualization — GEPA now generates an interactive HTML lineage tree of all candidates explored during optimization. Nodes are color-coded by role (best, Pareto front, seed) with hover previews and click-to-pin tooltips for reading full prompt text. The tree is automatically logged to WandB and MLflow at each step — no configuration needed. (#256)

    gskill: Automated Skill Learning for Coding Agents — A new gepa.gskill module that uses optimize_anything to automatically discover and learn repository-specific skills for coding agents, powered by SWE-smith and Docker. (#213)

    Top-K Pareto Candidate Selector — New candidate_selection_strategy="top_k_pareto" limits parent selection to the top-K candidates by aggregate score (default K=5), focusing mutation effort on the most promising programs. (#246)

    Improvements

    • Parallel evaluation on by default — EngineConfig now defaults to parallel=True with max_workers=os.cpu_count(). No configuration changes needed. (#240)
    • Atomic state saves — Checkpoints now use temp-file + os.replace(), preventing corruption on interrupted runs. (#242)
    • JSON run artifacts — run_log.json and candidates.json are now written to the run directory after each state save, enabling post-hoc analysis without extra code. (#245)
    • Cleaner experiment tracking — WandB/MLflow logging overhauled: engine config logged at start, best/seed prompts in summary, scalar metrics begin at step 0. (#243)
    • Earlier callback firing — on_optimization_start now fires before seed valset evaluation, not after. (#244)

    Bug Fixes

    • cloudpickle is now a proper dependency in the full extras group — use_cloudpickle=True no longer raises ModuleNotFoundError. (#242)

    Examples & Tutorials

    • Four new optimize_anything example suites: AIME math, ARC-AGI, circle packing, and blackbox optimization. (#234)
    • New tutorial on speeding up a Sudoku solver with GEPA. (#224)
    • Pydantic AI tutorial added to showcase. (#211)

    What's Changed

  5. v0.1.02026-02-19 · 2026-02-19 19:40 UTC
    查看更新说明

    Introducing optimize_anything, GEPA's new API for optimizing any text parameter. Checkout the blogpost at https://gepa-ai.github.io/gepa/blog/2026/02/18/introducing-optimize-anything/

    What's Changed

    Full Changelog: https://github.com/gepa-ai/gepa/compare/v0.0.27...v0.1.0

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    What is GEPA?

    GEPA (Genetic-Pareto) is a framework for optimizing any system with textual parameters against any evaluation metric. Unlike RL or gradient-based methods that collapse execution traces into a single scalar reward, GEPA uses LLMs to read full execution traces — error messages, profiling data, reasoning logs — to diagnose why a candidate failed and propose targeted fixes. Through iterative reflection, mutation, and Pareto-aware selection, GEPA evolves high-performing variants with minimal evaluations.

    If you can measure it, you can optimize it: prompts, code, agent architectures, scheduling policies, vector graphics, and more.

    Key Results

    90x cheaperOpen-source models + GEPA beat Claude Opus 4.1 at Databricks
    35x faster than RL100–500 evaluations vs. 5,000–25,000+ for GRPO (paper)
    32% → 89%ARC-AGI agent accuracy via architecture discovery
    40.2% cost savingsCloud scheduling policy discovered by GEPA, beating expert heuristics
    55% → 82%Coding agent resolve rate on Jinja via auto-learned skills
    50+ production usesAcross Shopify, Databricks, Dropbox, OpenAI, Pydantic, MLflow, Comet ML, and more

    "Both DSPy and (especially) GEPA are currently severely under hyped in the AI context engineering world" — Tobi Lutke, CEO, Shopify


    Installation

    pip install gepa
    

    To install the latest from main:

    pip install git+https://github.com/gepa-ai/gepa.git
    

    Quick Start

    Simple Prompt Optimization

    Optimize a system prompt for math problems from the AIME benchmark in a few lines of code (full tutorial):

    import gepa
    
    trainset, valset, _ = gepa.examples.aime.init_dataset()
    
    seed_prompt = {
        "system_prompt": "You are a helpful assistant. Answer the question. "
                         "Put your final answer in the format '### <answer>'"
    }
    
    result = gepa.optimize(
        seed_candidate=seed_prompt,
        trainset=trainset,
        valset=valset,
        task_lm="openai/gpt-4.1-mini",
        max_metric_calls=150,
        reflection_lm="openai/gpt-5",
    )
    
    print("Optimized prompt:", result.best_candidate['system_prompt'])
    

    Result: GPT-4.1 Mini goes from 46.6% → 56.6% on AIME 2025 (+10 percentage points).

    With DSPy (Recommended for AI Pipelines)

    The most powerful way to use GEPA for prompt optimization is within DSPy, where it's available as dspy.GEPA. See dspy.GEPA tutorials for executable notebooks.

    import dspy
    
    optimizer = dspy.GEPA(
        metric=your_metric,
        max_metric_calls=150,
        reflection_lm="openai/gpt-5",
    )
    optimized_program = optimizer.compile(student=MyProgram(), trainset=trainset, valset=valset)
    

    optimize_anything: Beyond Prompts

    The optimize_anything API optimizes any text artifact — code, agent architectures, configurations, SVGs — not just prompts. You provide an evaluator; the system handles the search.

    import gepa.optimize_anything as oa
    from gepa.optimize_anything import optimize_anything, GEPAConfig, EngineConfig
    
    def evaluate(candidate: str) -> float:
        result = run_my_system(candidate)
        oa.log(f"Output: {result.output}")      # Actionable Side Information
        oa.log(f"Error: {result.error}")         # feeds back into reflection
        return result.score
    
    result = optimize_anything(
        seed_candidate="<your initial artifact>",
        evaluator=evaluate,
        objective="Describe what you want to optimize for.",
        config=GEPAConfig(engine=EngineConfig(max_metric_calls=100)),
    )
    

    Use GEPA as an Agent Skill

    GEPA also ships as an Agent Skill so coding agents can drive optimize_anything for you. In a clone of this repo, Claude Code — and other agents that read .claude/skills/ (Cursor, VS Code/Copilot, Codex, Gemini CLI) — auto-discover it at .claude/skills/gepa-optimize-anything/. To use it in any other project, install the plugin from this repo's marketplace:

    /plugin marketplace add gepa-ai/gepa
    /plugin install gepa-optimize-anything@gepa
    

    See the Agent Skill guide for details.


    How It Works

    Traditional optimizers know that a candidate failed but not why. GEPA takes a different approach:

    1. Select a candidate from the Pareto frontier (candidates excelling on different task subsets)
    2. Execute on a minibatch, capturing full execution traces
    3. Reflect — an LLM reads the traces (error messages, profiler output, reasoning logs) and diagnoses failures
    4. Mutate — generate an improved candidate informed by accumulated lessons from all ancestors
    5. Accept — add to the pool if improved, update the Pareto front

    GEPA also supports system-aware merge — combining strengths of two Pareto-optimal candidates excelling on different tasks. The key concept is Actionable Side Information (ASI): diagnostic feedback returned by evaluators that serves as the text-optimization analogue of a gradient.

    For details, see the paper and the documentation.


    Adapters: Plug GEPA into Any System

    GEPA connects to your system via the GEPAAdapter interface — implement evaluate and make_reflective_dataset, and GEPA handles the rest.

    Built-in adapters:

    AdapterDescription
    DefaultAdapterSystem prompt optimization for single-turn LLM tasks
    ConfidenceAdapterLogprob-aware classification optimization — penalizes lucky guesses and feeds confidence diagnostics into reflection. pip install "gepa[confidence]"
    DSPy Full ProgramEvolves entire DSPy programs (signatures, modules, control flow). 67% → 93% on MATH.
    Generic RAGVector store-agnostic RAG optimization (ChromaDB, Weaviate, Qdrant, Pinecone)
    MCP AdapterOptimize MCP tool descriptions and system prompts
    TerminalBenchOptimize the Terminus terminal-use agent
    AnyMathsMathematical problem-solving and reasoning tasks
    LangChainOptimize prompts for any LangChain pipeline — chat models, tool-using agents, LangGraph. pip install "gepa[langchain]"

    See the adapters guide for how to build your own, and DSPy's adapter as a reference.


    Integrations

    GEPA is integrated into several major frameworks:


    Example Optimized Prompts

    GEPA can be thought of as precomputing reasoning during optimization to produce a plan for future task instances. Here are examples of the detailed prompts GEPA discovers:

    You will be given two input fields: question and summary_1.

    Your task is to generate a new search query (query) optimized for the second hop of a multi-hop retrieval system. The original user question is typically complex and requires information from multiple documents to answer. The first hop query is the original question used to retrieve an initial set of documents. Your goal is to generate a second hop query that retrieves additional relevant documents that were not found in the first hop but are necessary to answer the original question completely.

    Detailed task instructions and hints:

    1. Input Understanding:

      • question is the original multi-hop question posed by the user.
      • summary_1 is a concise summary of information from a document retrieved in the first hop, which partially addresses the question.
    2. Purpose and Context:

      • Your generated query aims to find the missing pieces of information needed to fully answer the question.
      • The multi-hop retrieval system works in stages:
        • First hop: The original question returns some documents.
        • Second hop: Your query must help retrieve any other relevant documents NOT found in the first hop that hold complementary or broader context necessary for final answer extraction.
    3. Key Observations from Examples and Feedback:

      • First-hop documents often cover one entity or aspect in the question.
      • Remaining relevant documents often involve connected or higher-level concepts mentioned in summary_1 but not explicitly asked in the original question.
      • The query should be formulated to explicitly target these missing, but logically linked, documents.
      • Avoid merely paraphrasing the original question or restating known facts from summary_1.
      • Instead, infer what broader or related entities/concepts might provide the crucial missing information.
      • For example, if summary_1 describes a population for a small civil parish, but the question wants total population of the wider region, your query should target that wider region (e.g., "Madeira archipelago population in 2011").
      • Similarly, if summary_1 covers a song and the question wants the album it came from, but first hop got song-level documents, your query should retrieve documents about the album itself.
    4. How to Build the Query:

      • Identify the entities or topics mentioned in summary_1 that appear related but different from first-hop documents.
      • Reframe the query to explicitly mention these broader or related entities connected to the original question.
      • Include relevant key context from the question to maintain specificity, but shift focus to the missing piece.
      • The goal is to retrieve documents that link or complement what was retrieved initially.
    5. Practical Strategy:

      • Read the summary_1 carefully to spot references to bigger contexts or other entities not covered in the first hop.
      • Ask yourself, "What entity or aspect does this summary hint at that could answer the original question but was not found yet?"
      • Formulate a precise, focused factual query targeting that entity or concept to retrieve the missing documents.
    6. Output:

      • Produce only the field query as a clear, concise question or keyword phrase designed for efficient retrieval of second-hop documents.
      • Ensure the query relates logically to the original question while targeting the broader or complementary knowledge identified in summary_1.
      • Do not include the original question or simply rephrase it.
      • Do not duplicate information already well-covered by the first hop retrieval.

    By following these principles, you will help the multi-hop retrieval system find all necessary documents to answer the multi-faceted original question completely.

    [HotpotQA Prompt End]

    [AIME Prompt Begin]

    You will be given one math problem as plain text under a key like "problem." Your job is to solve it correctly and return:

    • reasoning: a concise, logically ordered solution that uses identities/structure to avoid brute force, ends with a quick verification.
    • answer: the final requested number/expression only (no extra words).

    Formatting:

    • Use exactly two top-level fields named "reasoning" and "answer."
    • Keep reasoning succinct but complete. Bullet points are fine.
    • The answer field must contain only the final value requested (e.g., 227, 585, 601).

    General problem-solving guidance:

    • Parse the problem type (e.g., base representation, intersecting families of subsets, avoiding arithmetic progressions, symmetric sums with constraints, ordered tuples counting).
    • Always enforce domain constraints (e.g., base-b digits in 0..b−1; no leading zero for base-10 "three-digit"; ordered vs unordered families; strict increase conditions in sequences).
    • Use algebraic identities and modular arithmetic to reduce the search space; prefer structural arguments over naive enumeration.
    • For "greatest/least" questions, derive tight bounds and give a construction that attains them.

    Domain-specific strategies and pitfalls (learned from typical contest problems and prior feedback):

    1. Base-conversion/digit rearrangement:
    • Translate positional notation correctly: in base b, (a b c)_b = a·b^2 + b·b + c; in base 10: abc = 100a + 10b + c.
    • Enforce digit ranges strictly (e.g., in base 9, digits ∈ {0,…,8}; if also a is a base-10 leading digit, then a ∈ {1,…,8}).
    • Set up equality and simplify. Use modular constraints to prune: • Mod 9 often collapses coefficients; e.g., 99a = 71b + 8c ⇒ mod 9 gives b + c ≡ 0 (mod 9). • Mod 8: 99 ≡ 3, 71 ≡ 7 ⇒ 3a ≡ 7b (mod 8) ⇒ b ≡ −3a (mod 8).
    • Solve within digit bounds and verify numerically.
    1. Palindromes across bases:
    • Bound the base length by magnitude (e.g., n < 1000 ⇒ octal has 3–4 digits).
    • Characterize palindromes: • 3-digit octal: (A B A)_8 = 65A + 8B. • 4-digit octal: (A B B A)_8 = 513A + 72B (with A ≥ 1).
    • Enumerate small parameter ranges and test the other-base palindrome constraint. For "greatest", check candidates in descending order with justification.
    1. Symmetric sums with a + b + c fixed (ordered triples of nonnegative integers):
    • Use identities to compress expressions: S = ab(a + b) + bc(b + c) + ca(c + a) = (a + b + c)(ab + bc + ca) − 3abc.
    • With a + b + c known (e.g., 300), convert the given sum into a relation among ab + bc + ca and abc.
    • Use the shift a = A + x etc. to isolate a product like (a−A)(b−A)(c−A) and deduce factorization constraints, enabling clean counting.
    • Count ordered solutions carefully; include/exclude symmetric/degenerate cases precisely.
    1. Intersecting families of subsets (collections from the power set):
    • Intersecting means every pair has nonempty intersection. The empty set cannot be included.
    • Complement pairs: S and S^c cannot both be present. Use this to structure counts.
    • Use size-based pigeonhole facts: In [n], any two subsets of size > n/2 must intersect. For n = 5, any two subsets of size ≥ 3 intersect; thus "all subsets of size ≥ 3" is an intersecting family (size 16).
    • Do not assume that "stars" (all subsets containing a fixed element) are the only intersecting families of maximum size. For odd n, both the star and "all subsets of size > n/2" have size 2^{n−1}.
    • When counting collections of a fixed size: • Consider the minimum set size N in the family and do casework on how many 2-element sets are included (for n=5), as these control which 3-sets must be excluded (complements). • Ensure completeness of cases and avoid double counting by parameterizing canonical patterns (e.g., how many 2-sets, how they overlap, whether they share a common element). • Remember order of subsets in a collection does not matter; count distinct families.
    1. Avoiding 4-term arithmetic progressions in a strictly increasing sequence with fixed anchors:
    • First bound the variable terms by strict increase (e.g., if fixed terms are 3,4,5,...,30,40,50 then 6 ≤ a < b ≤ 29).
    • Pre-eliminate values that cause a 4-term AP with three fixed terms: • 3,4,5,a forbids a = 6. • b,30,40,50 forbids b = 20. • Similarly, a,30,40,50 forbids a = 20.
    • Start with the count of pairs from allowed values and then subtract specific pairs that complete APs with two fixed endpoints: • 3,5,a,b ⇒ (a,b) = (7,9). • 3,a,b,30 ⇒ (a,b) = (12,21). • 4,a,b,40 ⇒ (a,b) = (16,28). • 5,a,b,50 ⇒ (a,b) = (20,35) but may be outside bounds or pre-excluded (e.g., 20 banned).
    • Systematically check all endpoint combinations; use the fact that if endpoints differ by Δ, then Δ must be divisible by 3 for a 4-term AP, and solve for integer a,b within bounds.
    • Avoid double subtraction; ensure monotonicity and domain constraints are respected.
    1. Order statistics with sum and absolute-sum constraints (e.g., x_1 ≤ ... ≤ x_n, sum |x_i| = 1, sum x_i = 0):
    • Total positive mass equals total negative mass: both = 1/2.
    • For maximizing x_k (k near the top): if there are T largest terms from k to n (T = n − k + 1), then sum of these T terms ≥ T·x_k. Since the total positive mass ≤ 1/2, we get x_k ≤ (1/2)/T.
    • For minimizing x_l (l near the bottom): if there are l smallest terms, sum of these l terms ≤ l·x_l. Since the total negative mass is −1/2, we get x_l ≥ (−1/2)/l.
    • To attain these bounds, concentrate masses evenly on exactly those positions: set the smallest l terms equal to −1/(2l), the largest T terms equal to 1/(2T), and the middle to 0 (respecting monotonicity). Verify sums and absolute sums.
    • Example: For n=100, maximize x_76 − x_16: T = 25 ⇒ x_76 ≤ 1/50; l = 16 ⇒ x_16 ≥ −1/32; construction with 16 negatives at −1/32, 59 zeros, 25 positives at 1/50 attains 1/50 − (−1/32) = 41/800.

    Quality checks:

    • Verify digit/base constraints and final equalities numerically if applicable.
    • For extremal problems, provide both a tight bound and an explicit construction achieving it.
    • For counting, explicitly handle ordered vs unordered, exclude impossible/duplicate cases, and check complements/forbidden pairs.
    • For AP-avoidance, confirm integrality and bounds; ensure no missed endpoint combinations.
    • For "greatest/least" questions, justify optimality structurally (e.g., convexity/majorization/pigeonhole).

    Finally:

    • Put the clean final numeric result in the "answer" field only.

    [AIME Prompt End]


    When GEPA Shines

    • Expensive rollouts — Scientific simulations, complex agents with tool calls, slow compilation. GEPA needs 100–500 evals vs 10K+ for RL.
    • Scarce data — Works with as few as 3 examples. No large training sets required.
    • API-only models — No weights access needed. Optimize GPT-5, Claude, Gemini directly through their APIs.
    • Interpretability — Human-readable optimization traces show why each prompt changed.
    • Complements RL — Use GEPA for rapid initial optimization, then apply RL/fine-tuning for additional gains (BetterTogether).

    Further Reading


    Contributions

    We welcome adapters, bug fixes, and new use cases. See src/gepa/adapters/ for adapter examples and the contributing guide.

    Want to highlight your use case? Reach out to [email protected] or submit via GitHub.


    Contributors

    Everyone who has committed to this repository, written a post on the GEPA blog, or authored the GEPA or optimize_anything paper. This list is generated by docs/scripts/generate_contributors.py. If you're missing, or you'd like your full name or GitHub account shown, please open an issue or a PR.


    Citation

    @misc{agrawal2025gepareflectivepromptevolution,
          title={GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning},
          author={Lakshya A Agrawal and Shangyin Tan and Dilara Soylu and Noah Ziems and Rishi Khare and Krista Opsahl-Ong and Arnav Singhvi and Herumb Shandilya and Michael J Ryan and Meng Jiang and Christopher Potts and Koushik Sen and Alexandros G. Dimakis and Ion Stoica and Dan Klein and Matei Zaharia and Omar Khattab},
          year={2025},
          eprint={2507.19457},
          archivePrefix={arXiv},
          primaryClass={cs.CL},
          url={https://arxiv.org/abs/2507.19457},
    }