Awesome-LLM-Reasoning-with-NeSy

LAMDA-NeSy长期未更新

汇总大语言模型时代神经符号学习的最新进展,涵盖一阶逻辑、逻辑编程、知识图谱与具身智能等方向,帮研究者快速跟进这个交叉领域的论文与资源。

✨✨Latest Advances on Neuro-Symbolic Learning in the era of Large Language Models

暂无版本335star30fork同步于 2026-11-07 07:29 UTC

怎么上手

由 README 提炼,执行前请确认
README 未说明
硬件要求按 README 说明

README 未说明

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

神经符号学习与 LLM 推理规划方向的论文资源合集,帮你快速定位该领域的关键工作

汇总大语言模型时代神经符号学习的最新进展,涵盖一阶逻辑、逻辑编程、知识图谱与具身智能等方向,帮研究者快速跟进这个交叉领域的论文与资源。

核心能力

  • 按符号到 LLM、LLM 到符号等方向分类整理论文
  • 收录教程、综述、基础框架与数据集基准
  • 覆盖符号求解器、程序辅助、工具与搜索增强方法
  • 汇总符号反馈、微分符号模块等融合路线

容易踩的坑

这是论文与资源清单仓库,不是可直接安装运行的代码库;多数条目仅提供论文链接,代码需跳转各自 GitHub 仓库获取

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

0 个版本

暂无 release 数据(可能没有发版,或尚未同步)。

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    📌 Awesome Tutorials & Workshops & Talks

    🔍 Survey

    Survey on LLM Reasoning

    Survey on LLM Planning

    Survey on Neuro-Symbolic Learning

    📖 Basic Neuro-Symbolic Frameworks

    TitleVenueDateCode
    Semantic-based regularization for learning and inference Artificial Intelligence2017-
    DeepProbLog: Neural Probabilistic Logic Programming NeurIPS2018Github
    Learning Explanatory Rules from Noisy Data Journal of Artificial Intelligence Research2018Github
    Augmenting Neural Networks with First-order Logic ACL2019-
    Neural Logic Machines ICLR2019Github
    Bridging Machine Learning and Logical Reasoning by Abductive Learning NeurIPS2019Github
    SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver ICML2019Github
    DL2: Training and Querying Neural Networks with Logic ICML2019Github
    The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision ICLR2019Github
    NeurASP: Embracing Neural Networks into Answer Set Programming IJCAI2020Github
    Learning programs by learning from failures Machine Learning2020-
    Logical Neural Networks Arxiv2020Github
    Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning ICML2020Github
    Ontology Reasoning with Deep Neural Networks Artificial Intelligence2020-
    MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks AAAI2022-
    Neuro-Symbolic Hierarchical Rule Induction ICML2022-
    Logic Tensor Networks Artificial Intelligence2022Github
    Neuro-symbolic Learning Yielding Logical Constraints NeurIPS2023Github
    Neural-Symbolic Recursive Machine for Systematic Generalization ICLR2024Github

    📖 Symbolic to LLM

    Symbolic Generation, LLM Imitation

    TitleVenueDateDomainCode
    Solving Olympiad geometry without human demonstrationsNature2024Geometric Math ReasoningGithub
    Chain of Thought Imitation with Procedure Cloning NeurIPS2022PlanningGithub
    Plansformer: Generating Symbolic Plans using Transformers Arxiv2022Planning-
    Beyond A$^*$: Better Planning with Transformers via Search Dynamics BootstrappingArxiv2024PlanningGithub
    Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces Arxiv2024PlanningGithub
    Stream of Search (SoS): Learning to Search in Language COLM2024ReasoningGithub
    Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language ModelsArxiv2025ReasoningGithub
    Language Models can be Deductive Solvers NAACL2024Logical ReasoningGithub
    INT: An Inequality Benchmark for Evaluating Generalization in Theorem ProvingICLR2021Theorem ProvingGithub
    Generating Millions Of Lean Theorems With Proofs By Exploring State Transition GraphsArxiv2025Theorem Proving-
    Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus NeurIPS2024Logical Reasoning-
    A Symbolic Framework for Evaluating Mathematical Reasoning and Generalization with Transformers NAACL2024Math ReasoningGithub
    Proving Olympiad Algebraic Inequalities without Human DemonstrationsNeurIPS2024Theorem ProvingGithub
    LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language ModelsEMNLP2024Logical ReasoningGithub

    LLM Formalize, Symbolic Augment

    TitleVenueDateDomainCode
    AMR-DA: Data Augmentation by Abstract Meaning Representation ACL2022Logic ReasoningGithub
    Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning ACL2024Logic ReasoningGithub
    Neuro-Symbolic Data Generation for Math Reasoning NeurIPS2024Math Reasoning-
    LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM SCI-FM Workshop @ ICLR2025Legal ReasoningGithub
    AlphaIntegrator: Transformer Action Search for Symbolic Integration ProofsArxiv2024Theorem Proving-
    Large Language Models Meet Symbolic Provers for Logical Reasoning EvaluationICLR2025Logic ReasoningGithub

    📖 LLM to Symbolic

    Symbolic Solver Aided Methods

    TitleVenueDateDomainCode
    MRKL Systems: A modular, Neuro-Symbolic Architecture that Combines Large Language models, External Knowledge Sources and Discrete Reasoning Arxiv2022Reasoning-
    Leveraging Large Language Models to Generate Answer Set Programs KR2023ReasoningGithub
    Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning EMNLP2023ReasoningGithub
    LOGIC-LM++: Multi-Step Refinement for Symbolic Formulations ACL2024Reasoning-
    LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers EMNLP2023ReasoningGithub
    Faithful Chain-of-Thought Reasoning IJCNLP-AACL2023ReasoningGithub
    SATLM: Satisfiability-Aided Language Models Using Declarative Prompting NeurIPS2023Math ReasoningGithub
    Faithful Logical Reasoning via Symbolic Chain-of-Thought ACL2023ReasoningGithub
    Verification and Refinement of Natural Language Explanations through LLM-Symbolic Theorem Proving EMNLP2024Theorem ProvingGithub
    StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation ICML2024Code Generation-
    Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context NeurIPS2023Code GenerationGithub
    Solving Math Word Problems by Combining Language Models With Symbolic Solvers Arxiv2023Math ReasoningGithub
    AutoSAT: Automatically Optimize SAT Solvers via Large Language Models Arxiv2024SAT ProblemGithub
    Prototype-then-Refine: A Neuro-Symbolic Approach for Improved Logical Reasoning with LLMs Arxiv2024Reasoning-
    Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs Arxiv2024ReasoningGithub
    SymBa: Symbolic Backward Chaining for Structured Natural Language Reasoning Arxiv2025ReasoningGithub
    Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning AAAI2024Math Reasoning-
    Lemur: Integrating Large Language Models in Automated Program Verification ICLR2024Code Generation-
    Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning NeurIPS2023RoboticsGithub
    Parsel: Algorithmic Reasoning with Language Models by Composing DecompositionsNeurIPS2023RoboticsGithub
    Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning EMNLP2024Spatial Reasoning-
    Generalized Planning in PDDL Domains with Pretrained Large Language Models AAAI2024PlanningGithub
    Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning NeurIPS2023PlanningGithub
    Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text ACL Findings2023PlanningGithub
    LLM+P: Empowering Large Language Models with Optimal Planning Proficiency Arxiv2023Planning/RoboticsGithub
    Dynamic Planning with a LLM LanGame Workshop @ NeurIPS2023Planning/Robotics-
    Neuro-Symbolic Procedural Planning with Commonsense Prompting ICLR2023Planning/RoboticsGithub
    Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models NeurIPS2024PlanningGithub
    A Framework for Neurosymbolic Robot Action Planning using Large Language Models Frontiers in Neurorobotics2024RoboticsGithub
    ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation Arxiv2024Robotics-
    LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsNeurIPS D&B2023Theorem ProvingGithub
    LEGO-Prover: Neural Theorem Proving with Growing LibrariesICLR2024Theorem ProvingGithub
    Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning ICLR2025Theorem ProvingGithub
    Autoformalization with Large Language Models NeurIPS2022Theorem Proving-
    Autoformalizing Euclidean GeometryICML2024Geometry ReasoningGithub
    Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency NeurIPS2024Theorem ProvingGithub
    Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs ICLR2023Theorem ProvingGithub
    Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization ICLR2024Theorem ProvingGithub
    Large Language Models as Planning Domain Generators ICAPS2024PlanningGithub
    Generating Symbolic World Models via Test-time Scaling of Large Language Models ICML2024Planning-

    Program-Aided Methods

    TitleVenueDateDomainCode
    PAL: Program-aided Language Models ICML2023ReasoningGithub
    Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks TMLR2023Math ReasoningGithub
    Binding Language Models in Symbolic Languages ICLR2023ReasoningGithub
    Chain of Code: Reasoning with a Language Model-Augmented Code EmulatorICML2024ReasoningGithub
    CODE4STRUCT: Code Generation for Few-Shot Event Structure PredictionACL2023ReasoningGithub
    MathPrompter: Mathematical Reasoning using Large Language ModelsACL2023Math ReasoningGithub
    Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning ACL2024ReasoningGithub
    Towards Better Understanding of Program-of-Thought Reasoning in Cross-Lingual and Multilingual EnvironmentsArxiv2025Reasoning-
    Code as Policies: Language Model Programs for Embodied Control Arxiv2023RoboticsGithub

    Tool-Aided Methods

    TitleVenueDateCode
    Visual Programming: Compositional visual reasoning without trainingCVPR (Best Paper)2023Visual Reasoning
    ViperGPT: Visual Inference via Python Execution for ReasoningICCV2023Visual Reasoning
    GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules ICLR2024Visual Reasoning
    Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsNeurIPS2023Multi-Modal Reasoning
    HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceNeurIPS2023Visual Reasoning
    ART: Automatic Multi-Step Reasoning and Tool-use for Large Language Models Arxiv2023Reasoning
    ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language ModelsEMNLP2023Reasoning
    ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving ICLR2024Math Reasoning
    ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool EmbeddingsNeurIPS2023Agent
    TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIsArxiv2023Agent
    ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIsICLR2024Agent
    Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool UsageICLR2025Visual Reasoning
    ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and FeedbackEMNLP2024Reasoning
    START: Self-taught Reasoner with ToolsArxiv2025Reasoning

    Search Augmented Methods

    TitleVenueDateDomainCode
    Self-Evaluation Guided Beam Search for ReasoningNeurIPS2023ReasoningGithub
    Deductive Beam Search: Decoding Deducible Rationale for Chain-of-Thought ReasoningCOLM2024ReasoningGithub
    MindStar: Enhancing Math Reasoning in Pre-trained LLMs at Inference TimeArxiv2024Reasoning-
    NEUROLOGIC A*esque Decoding:Constrained Text Generation with Lookahead HeuristicsNAACL2022Reasoning-
    Marco-o1: Towards Open Reasoning Models for Open-Ended SolutionsArxiv2024ReasoningGithub
    Monte Carlo Tree Search Boosts Reasoning via Iterative Preference LearningArxiv2024ReasoningGithub
    LLaMA-Berry: Pairwise Optimization for Olympiad-level Mathematical Reasoning via O1-like Monte Carlo Tree Search Arxiv2024ReasoningGithub
    Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree SearchArxiv2024Visual ReasoningGithub
    Large Language Models as Commonsense Knowledge for Large-Scale Task PlanningNeurIPS2023PlanningGithub
    Planning with Large Language Models for Code Generation ICLR2023Code GenerationGithub
    Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsNeurIPS2023ReasoningGithub
    CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models Arxiv2024Code Generation-
    Alphazero-like Tree-Search can Guide Large Language Model Decoding and TrainingArxiv2024Reasoning-
    Reasoning with Language Model is Planning with World Model EMNLP2023Reasoning-
    Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning ICLR2024Reasoning-
    SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models ICLR2025ReasoningGithub
    Leveraging Constrained Monte Carlo Tree Search to Generate Reliable Long Chain-of-Thought for Mathematical Reasoning Arxiv2025Math Reasoning-
    FGeo-DRL:Deductive Reasoning for Geometric Problems through Deep Reinforcement Learning Arxiv2024Geometry ReasoningGithub
    Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language ModelsArxiv2024ReasoningGithub
    AlphaMath Almost Zero: Process Supervision without ProcessNeurIPS2024Math ReasoningGithub
    Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations ACL2024Math ReasoningGithub
    Improve Mathematical Reasoning in Language Models by Automated Process SupervisionDeepMind Report2024Math Reasoning-
    ReST-MCTS: LLM Self-Training via Process Reward Guided Tree SearchNeurIPS2024Math/Chemistry/PhysicsGithub
    rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep ThinkingICLR2025Math ReasoningGithub
    Enhancing Reasoning through Process Supervision with Monte Carlo Tree SearchNeurMAD Workshop @ AAAI2025Math Reasoning-
    STP: Self-play LLM Theorem Provers with Iterative Conjecturing and ProvingArxiv2025Theorem ProvingGithub
    SRA-MCTS: Self-driven Reasoning Augmentation with Monte Carlo Tree Search for Code GenerationArxiv2024ReasoningGithub

    📖 LLM plus Symbolic

    Symbolic Formatted Reasoning

    TitleVenueDateDomainCode
    Deductive Verification of Chain-of-Thought ReasoningNeurIPS2023ReasoningGithub
    Show Your Work: Scratchpads for Intermediate Computation with Language Models DL4C Workshop @ ICLR2022Code Generation-
    Chain-of-Symbol Prompting Elicits Planning in Large Langauge ModelsCOLM2024Spatial Reasoning/Path PlanningGithub
    Learning to Reason via Program Generation, Emulation, and SearchNeurIPS2024ReasoningGithub
    Symbolic Working Memory Enhances Language Models for Complex Rule ApplicationEMNLP2024ReasoningGithub
    CodeI/O: Condensing Reasoning Patterns via Code Input-Output PredictionArxiv2025ReasoningGithub
    SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language ModelsCOLING2025ReasoningGithub
    Improving Chain-of-Thought Reasoning via Quasi-Symbolic AbstractionsArxiv2025Reasoning-
    ProgPrompt: Generating Situated Robot Task Plans using Large Language Models ICRA2023RoboticsGithub
    Programmatically Grounded, Compositionally Generalizable Robotic Manipulation ICLR2023RoboticsGithub
    CodePlan: Unlocking Reasoning Potential in Large Language Models by Scaling Code-form Planning ICLR2025ReasoningGithub

    Differential Symbolic Modules

    TitleVenueDateDomainCode
    Inferring and Executing Programs for Visual Reasoning ICCV2017Visual ReasoningGithub
    Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding NeurIPS2018Visual ReasoningGithub
    The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision ICLR2019Visual ReasoningGithub
    Visual Concept-Metaconcept Learning NeurIPS2019Visual ReasoningGithub
    Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning” ICML2020Visual ReasoningGithub
    Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language NeurIPS2021Visual ReasoningGithub
    Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning ICLR2021Visual ReasoningGithub
    JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied AgentsArxiv2022Robotics-
    FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual RelationsICLR2022Visual ReasoningGithub
    NS3D: Neuro-Symbolic Grounding of 3D Objects and RelationsCVPR2023Visual ReasoningGithub
    Interpretable Neural-Symbolic Concept ReasoningICML2023InterpretableGithub
    Motion Question Answering via Modular Motion ProgramsICML2023Motion QAGithub
    Learning Neuro-symbolic Programs for Language Guided Robot ManipulationICRA2023RoboticsGithub
    \alpha ILP: thinking visual scenes as differentiable logic programsMachine Learning2023Visual Reasoning
    What's Left? Concept Grounding with Logic-Enhanced Foundation ModelsNeurIPS2023Visual ReasoningGithub
    Programmatically Grounded, Compositionally Generalizable Robotic Manipulation ICLR2023RoboticsGithub
    Neuro-Symbolic Predicate Invention:Learning Relational Concepts from Visual ScenesNSAI2024Visual ReasoningGithub
    Take A Step Back: Rethinking the Two Stages in Visual ReasoningECCV2024Visual ReasoningGithub
    Learning Differentiable Logic Programs for Abstract Visual Reasoning MLJ2024Visual Reasoning-
    DiLA: Enhancing LLM Tool Learning with Differential Logic Layer Arxiv2024Reasoning-
    Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural NetworksICLR2024ReasoningGithub
    Empowering Language Models with Knowledge Graph Reasoning for Question AnsweringEMNLP2022Reasoning-
    Neuro-symbolic Training for Spatial Reasoning over Natural Language Arxiv2025Spatial ReasoningGithub
    NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalization Arxiv2024Visual ReasoningGithub

    Symbolic Feedback

    TitleVenueDateDomainCode
    CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution ECAI2024Code Generation-
    Position: LLMs Can’t Plan, But Can Help Planning in LLM-Modulo Frameworks ICML2024Planning-
    RLSF: Reinforcement Learning via Symbolic Feedback Arxiv2025ReasoningGithub
    Rule Based Rewards for Language Model Safety NeurIPS2024-

    Misc on Neuro-Symbolic Learning

    TitleVenueDateCode
    Neuro-Symbolic Entropy Regularization UAI2022Github
    RuleMatch: Matching Abstract Rules for Semi-supervised Learning of Human Standard Intelligence Tests IJCAI2023Github
    Learning with Logical Constraints but without Shortcut Satisfaction ICLR2023Github
    Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal ICML2023Github
    Out-of-Distribution Generalization by Neural-Symbolic Joint Training AAAI2023Github
    Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts NeurIPS2023-
    Localized Symbolic Knowledge Distillation for Visual Commonsense Models NeurIPS2023-
    A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inference NeurIPS2023-
    Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal ICML2023Github
    Out-of-Distribution Generalization by Neural-Symbolic Joint Training AAAI2023Github
    Large Language Models Are NeuroSymbolic Reasoners AAAI2024Github
    On the Hardness of Probabilistic Neurosymbolic Learning ICML2024-
    On the Independence Assumption in Neurosymbolic Learning ICML2024-
    Analysis for Abductive Learning and Neural-Symbolic Reasoning Shortcuts ICML2024-
    Convex and Bilevel Optimization for Neural-Symbolic Inference and Learning ICML2024-
    Bridging Neural and Symbolic Representations with Transitional Dictionary Learning ICLR2024-
    LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints ICLR2024-
    Adaptable Logical Control for Large Language Models NeurIPS2024-
    Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts NeurIPS2024-
    Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought NeurIPS2024Github

    🛠️ Awesome Datasets & Benchmarks

    Mathematical Reasoning

    Logical Reasoning

    Code Generation

    Visual Reasoning

    Geometry Reasoning

    Classical Planning

    Game AI Planning

    Robotic Planning

    AI Agent Planning

    Others

    • RSbench: A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts