Search Results for "balancer"

Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The architecture is designed with privacy and cost control in mind, making it suitable for organizations that handle sensitive data or require predictable operational costs. ...

...Let's embrace the reality, we almost always have to deal with more than one protocol. It was once Thrift, today it's gRPC, and REST never gets old. At the same time, you sometimes have to handle health check requests from a load balancer or even serve some static files. Armeria is capable of running services using different protocols, all on a single port. No need for any proxies or sidecars. Enjoy the reduced complexity and points of failure, even when migrating between protocols!

EPLB is DeepSeek’s open implementation of a load balancing algorithm designed for expert parallelism (EP) settings in MoE architectures. In EP, different “experts” are mapped to different GPUs or nodes, so load imbalance becomes a performance bottleneck if certain experts are invoked much more often. EPLB solves this by duplicating heavily used experts (redundancy) and then placing those duplicates across GPUs to even out computational load. It uses policies like hierarchical load balancing...

OpenAS2 is a java-based implementation of the EDIINT AS2 standard. It is intended to be used as a server. It is extremely configurable and supports a wide variety of signing and encryption algorithms. Supports very high traffic volume allowing parallel processing of files per partner. SUPPORT: Please use the Github issues and Discussions channels here: https://github.com/OpenAS2/OpenAs2App/ Requirements: - Java 11 or newer (tested with the LTS versions of Java up to 21) ...

The Seshat Extended Naming and Balancing Service supplies a fully conformant COS Naming Service with extensions allowing you to store any serialized object in the naming tree. The Service also supplies a Balancer for session balancing multiple CORBA servants of the same type in balanced groups. The balanced groups can be bound to the naming tree. If you look up a balanced group you will transparently get a reference to an object in the group. The members of a group can be delivered either using a round robin or a random algorithm. The service uses Spring Security Framework for access control and can be configured to use any Authentication Authorization system supported by the Spring Security Framework.

This project is about to give you a simple (but powerful) loadbalancer written in JAVA. "The performance of a Java based load balancer may never match that of a well written load balancer in C/C++, but as teh platform is evolves further, it can only get better." (from http://javalb.sourceforge.net/) My project is a mutch more simple way to have a TCP loadbalancer. It has a hard coded round robin (tictoc) algorythm, and (right now) limited to 2 realservers (it will change in the future)

Zebra_Session is a PHP class that acts as a wrapper for PHP's default session handling functions but instead of storing session data in flat files it stores them in a MySQL database, thus providing both better security and better performance. The library is also a solution for applications that are scaled across multiple web servers (using a load balancer or a round-robin DNS) and where the user's session data needs to be available. Storing sessions in a database makes them available to all of the servers! Zebra_Session's code is heavily commented and generates no warnings/errors/notices when PHP's error reporting level is set to E_ALL. Starting with version 2.0, Zebra_Session implements row locks, ensuring that data is correctly handled in a scenario with multiple concurrent AJAX requests.

Elastica is a highly efficient and extensible, rules-based load-balancer for JBoss that adds dynamic behavior to EJB load balancing. Rules can be defined to redirect EJB requests according to request data, server performance data, or even the time of day

Software load balancer. Accepts connections and distributes them to an array of back end servers. Unique/advanced features include integrated testing of back end servers and optional termination of client connections to misfunctioning servers.

The project is a fully functional Java based IP load balancer. It has a web based admin UI to setup the configuration such as the number of real servers and their addressess, ping times to monitor the health of each of the real servers, the protocols supp

OpenLoadMon is a load monitor for Apache proxy balancer. It can obtain the runtime load info from back-end servers, calculate the dynamic load factors, and pass them to the Apache proxy balancer. It implements a general framework for various web servers