Zaccarini, MattiaMattiaZaccariniPereira dos Santos, José PedroJosé PedroPereira dos SantosPoltronieri, FilippoFilippoPoltronieriDi Cicco, NicolaNicolaDi CiccoTortonesi, MauroMauroTortonesiStefanelli, CesareCesareStefanellide Turck, FilipFilipde Turck2026-11-162026-11-162026979-8-3315-9269-11542-1201https://imec-publications.be/handle/20.500.12860/60821The increasing deployment of Virtual Network Functions (VNFs) across the Compute Continuum (CC)-spanning cloud, fog, and edge environments- has introduced new challenges in orchestrating network services efficiently and sustainably. As network infrastructures scale to support latency-sensitive and resource-intensive applications, such as eXtended Reality (XR) and Generative Artificial Intelligence (GenAI) applications, existing orchestration strategies often prioritize performance while overlooking energy consumption and carbon footprint, leading to environmentally costly outcomes. Motivated by the urgent need for greener network management solutions, this work proposes GaiaRL, a Multi-Objective Reinforcement Learning (MORL) framework for sustainable VNF placement in distributed edge-to-cloud environments. GaiaRL formulates the orchestration problem as a sequential decision-making problem, balancing conflicting objectives such as deployment cost, latency, energy consumption, and fair resource utilization. We implement and evaluate multiple MORL algorithms-alongside a novel Geometric Pareto Q-Learning (GeoPQL) method-and compare them against single-objective baselines from previous work. Experiments using realistic 5G deployments across compute continuum scenarios show that MORL algorithms better balance the trade-offs between different objectives and drive energy-aware orchestration in modern computing scenarios, paving the way toward sustainable network management in 6G and beyond.eng<i>GaiaRL</i>: Multi-Objective RL for Sustainable VNF Placement in the Compute ContinuumProceedings paper10.1109/noms69089.2026.11668312WOS:001901818900139VIRTUAL RESOURCESORCHESTRATION