Development of an on-demand HPC task submission portal

inLab FIB collaborates with the Barcelona Innovative Transportation (BIT) research group at ETSECCPB on the development of a platform for managing and submitting high-performance computing (HPC) tasks, as part of the European E-MED project. The solution aims to facilitate access to computing resources and simplify the execution of simulations and computationally intensive processes, providing a scalable, secure and user-friendly infrastructure for researchers.

To achieve this objective, the project envisages the design and development of a distributed architecture that enables the automation of the submission, management and monitoring of HPC tasks. In this context, the following actions have been carried out:

• Problem analysis and design of a distributed task-scheduling architecture based on queuing systems.
• Development of a web UI that allows authenticated users to submit, manage and query the status of HPC jobs.
• Implementation of an asynchronous task-processing agent integrated with Slurm, responsible for automating the execution of jobs on the computing infrastructure.
• Deployment of the solution to the private cloud, providing a robust, scalable environment ready to handle intensive workloads.

This development contributes to improving accessibility to HPC resources, optimising the management of computational processes and providing a flexible platform that facilitates researchers’ work within the European E-MED project.