LLM Orchestration Frameworks AI Tools

Open-source TypeScript framework for building, running, and observing AI agents in production.

Open-source visual builder for LLM agents and RAG flows, deployable as an HTTP API or an MCP server.

Agent-building platform with a playground, visual workflow builder, agent marketplace and bring-your-own-model support, on web and mobile.

A serverless platform for building, deploying, and monitoring AI agents across 600-plus LLMs.

Paid Node boilerplate for AI SaaS: auth, Stripe or Lemon Squeezy billing, RAG endpoints and demo apps

Apache-licensed Python framework for building RAG pipelines and agents out of swappable components, maintained by deepset.

Query language and runtime for constrained LLM prompting, built at ETH Zurich's SRI Lab.

MIT-licensed Python/JavaScript framework for building LLM agents, with 1,000+ model and tool integrations

Memory layer for AI agents and apps that stores user facts and preferences between sessions and retrieves them on demand.