Sign in Subscribe

interpretability

MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning - Summary

The paper discusses the limitations of large language models (LMs) and proposes a neuro-symbolic architecture called the Modular Reasoning, Knowledge and Language (MRKL) system that combines LMs with external knowledge sources and discrete reasoning modules to overcome these limitations.

ReAct: Synergizing Reasoning and Acting in Language Models - Summary

The paper introduces ReAct, a novel prompt-based paradigm that synergizes reasoning and acting in language models for general task solving. ReAct generates both verbal reasoning traces and actions in an interleaved manner, allowing the model to perform dynamic reasoning to create, maintain, and adj