LangServe

LangServe helps developers deploy LangChain runnables and chains as REST APIs. Integrated with FastAPI and pydantic for data validation. Automatically infers input/output schemas from LangChain objects, enforced on every API call with rich error messages. Features API docs with JSONSchema and Swagger, efficient /invoke, /batch, /stream endpoints, and playground page at /playground/ with streaming output and intermediate steps. Essentially wraps LangChain chains/agents and turns them into FastAPI endpoints. Hosted LangServe available as part of LangSmith SaaS, directly interfacing with GitHub-hosted code and deploying to containers.