Open Source Java AI Agent Frameworks

AgentScope Java is an agent-oriented programming framework that enables Java developers to build intelligent, LLM-powered applications using a dynamic reasoning-acting (ReAct) paradigm. It provides a comprehensive toolkit for creating autonomous agents that can plan, execute, and adjust complex workflows, making decisions about which tools to invoke and how to solve multi-step problems. The framework includes runtime controls such as safe interruption and graceful cancellation to manage agent execution robustly in production environments. It also supports human-in-the-loop intervention, allowing developers or users to inject guidance at any point during reasoning while preserving state and tool context. Built with enterprise needs in mind, AgentScope Java integrates into traditional Java stacks and provides structured abstractions for memory, workflows, and tool invocation.

Agents-Flex includes a variety of network protocols for connecting LLMs, such as HTTP, SSE and WS. Its simple and flexible design allows developers to easily connect to various LLMs, including OpenAI, LLama, and other AI. Agents-Flex provides a rich set of development templates and Prompt Frameworks, including FEW-SHOT, CRISPE, BROKE, and ICIO. Developers can also customize their own unique prompt templates. Agents-Flex has a very flexible Function Calling component. It supports local method definitions, parsing, callbacks through LLMs, and executing local methods to obtain results. Agents-Flex offers Loader, Parser, and Splitter components for the Document. Each component has multiple implementations, making it easy to load data from the web, local files, databases, and various data types.

JAI-Workflow is a framework for building and managing machine learning workflows, streamlining the process from data ingestion to model deployment.