January 2026

Multi-agent systems often operate in dynamic and uncertain environments, where agents must not only pursue individual goals but also safeguard collective functionality. This challenge is especially acute in mixed-motive multi-agent systems. This work focuses on cooperative resilience, the ability of agents to anticipate, resist, recover, and transform in the face of disruptions, a critical yet underexplored property in Multi-Agent Reinforcement Learning. We study how reward function design influences resilience in mixed-motive settings and introduce a novel framework that […]

Ver mais

Real-world federated systems seldom operate on static data: input distributions drift while privacy rules forbid raw-data sharing. We study this setting as Federated Domain-Incremental Learning (FDIL), where (i) clients are heterogeneous, (ii) tasks arrive sequentially with shifting domains, yet (iii) the label space remains fixed. Two theoretical pillars remain missing for FDIL under realistic deployment: a guarantee of backward knowledge transfer (BKT) and a convergence rate that holds across the sequence of all tasks with partial participation. We […]

Ver mais

Limited access to medical infrastructure forces elderly and vulnerable patients to rely on home-based care, often leading to neglect and poor adherence to therapeutic exercises such as yoga or physiotherapy. To address this gap, we propose a low-cost and automated human activity recognition (HAR) framework based on wearable inertial sensors and machine learning. Activity data, including walking, walking upstairs, walking downstairs, sitting, standing, and lying, were collected using accelerometer and gyroscope measurements. Four classical classifiers, Logistic Regression, Random […]

Ver mais

Hey everyone! My company is releasing ARES (Agentic Research and Evaluation Suite) today: https://github.com/withmartian/ares We’re hoping ARES can be a new Gym style environment for long horizon coding tasks, with a couple opinionated design decisions: – async, so it can parallelize easily and to large workloads – treats LLMRequests as environment observations and LLMResponses as actions, so we can treat the underlying LLM as the policy instead of a full agent orchestrator – integrates with Harbor (harborframework.com) on […]

Ver mais

I am training AI players for a chess-like game which has 3 distinct factions (i.e. different piece sets) and is played on a 9×9 board. The three factions are called Axiom (A), Blades (B), and Clockwork (C). With help from ChatGPT, I have managed to create 6 different AI models, one for each match up (AvA, AvB, AvC, BvB, BvC and CvC), under an Alpha Zero style approach. The structure used (which I broadly understand but largely relied […]

Ver mais

Multi-objective optimization aims to solve problems with competing objectives, often with only black-box access to a problem and a limited budget of measurements. In many applications, historical data from related optimization tasks is available, creating an opportunity for meta-learning to accelerate the optimization. Bayesian optimization, as a promising technique for black-box optimization, has been extended to meta-learning and multi-objective optimization independently, but methods that simultaneously address both settings – meta-learned priors for multi-objective Bayesian optimization – remain largely […]

Ver mais

Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical. Existing approaches embed task-specific value functions into constrained optimization programs or learn deterministic structured policies, sacrificing generality and policy expressiveness. We propose a solver-induced emph{latent spherical flow policy} that brings the expressiveness of modern generative policies to combinatorial RL while guaranteeing feasibility by design. Our method, LSFlow, learns a emph{stochastic} policy […]

Ver mais