digitado

Cloud providers must assign heterogeneous compute resources to workflow DAGs while balancing competing objectives such as completion time, cost, and energy consumption. In this work, we study a single-workflow, queue-free scheduling setting and consider a graph neural network (GNN)-based deep reinforcement learning scheduler designed to minimize workflow completion time and energy usage. We identify specific out-of-distribution (OOD) conditions under which GNN-based deep reinforcement learning schedulers fail and provide a principled explanation of why these failures occur. Through controlled […]

Ver mais

Next-generation AI assistants being developed in the Apple ecosystem and by chipmakers like Qualcomm, but early reports suggest they are being designed with limits in place. Tom’s Guide has described early versions of these assistants as capable of navigating apps, carrying out bookings, and managing tasks in services. For instance a private beta agentic system completed tasks like booking services or posting content in apps. In one test, it moved through an app workflow and reached a payment […]

Ver mais

Maximum entropy reinforcement learning (MaxEnt RL) has become a standard framework for sequential decision making, yet its standard Gaussian policy parameterization is inherently unimodal, limiting its ability to model complex multimodal action distributions. This limitation has motivated increasing interest in generative policies based on diffusion and flow matching as more expressive alternatives. However, incorporating such policies into MaxEnt RL is challenging for two main reasons: the likelihood and entropy of continuous-time generative policies are generally intractable, and multi-step […]

Ver mais

DPO (Rafailov et al., NeurIPS 2023) is supposed to be the clean alternative to PPO. No reward model in the training loop, no value function, no rollout collection. Just a binary cross-entropy loss over preference pairs. And the math is elegant the partition function Z(x) cancels out when you substitute the log-ratio reparameterisation into the Bradley-Terry model. I implemented it from scratch as part of a multi-stage RLHF project (same model, same tokenizer, same evaluation suite as my […]

Ver mais

This legal fight between xAI and Colorado takes place at a time when governments are moving faster to regulate artificial intelligence than ever before. Senate Bill 24-205, one of the most ambitious attempts in the country to set rules for AI systems that influence real world decisions, was challenged by the lawsuit filed in a US District Court. Colorado’s law is an effort to address risks tied to AI across the United States, especially systems that can affect […]

Ver mais

Background/Objectives: Lung cancer survival depends on early detection; however, in the Philippines, high radiologist workloads and the anatomical complexity of chest X-rays (CXRs) contribute to missed pulmonary nodules and false-negative diagnoses. This study aims to develop an enhanced deep learning model to improve nodule classification and localization sensitivity. Methods: We propose RNNet-MST, an extension of ResNet-50 that incorporates Multi-Scale Transformer blocks for global context modeling and a custom spatial attention mechanism for attention-based weak localization of disease-relevant regions. […]

Ver mais

Distributed modern software platforms spanning microservices, serverless functions, and edge computing face unprecedented security threats from stealthy adversaries exploiting encrypted data flows and behavioural camouflage. Conventional defences require decryption for analysis, exposing sensitive information in untrusted cloud environments. This paper proposes an innovative framework integrating homomorphic encryption (HE) with automated threat hunting to enable privacy-preserving threat detection at scale. Using levelled BFV schemes from OpenFHE, we perform computations directly on ciphertexts for anomaly scoring and behavioural profiling, while […]

Ver mais

Decentralized applications (DApps) represent a paradigm shift in software architecture, leveraging blockchain technology and distributed consensus mechanisms to eliminate single points of failure and centralized control. As the adoption of DApps accelerates across sectors such as finance, supply chain, healthcare, and governance, ensuring their functional correctness and behavioral reliability has become a critical engineering challenge. Unlike traditional software, DApps operate in adversarial, permissionless environments where smart contracts execute autonomously and immutably on distributed nodes, making post-deployment correction extremely […]

Ver mais