Big Data Analytics Lab

This project is carried out with a multinational company based in Barcelona with the aim of implementing an experimental Big Data platform based on Open Source tools to facilitate and streamline processes to support the analysis and processing of data in order to improve their business processes.

The project focuses on improving a very specific use case, which serves as a starting point to define and implement a reference architecture.

It is in the definition of the reference architecture that the different technological components are specified. These technology components are Big Data tools that need to be carefully chosen based on the data structures and queries we anticipate will be made.

The project starts with the study of the source data, which allows us to make an initial choice of the Big Data tools that will be most useful to us. Once chosen, the different tools are evaluated, including benchmarking, to determine the speed of each solution in the chosen case.

Subsequently, an ontology of the data is created so that the company’s data analysts, who need data matrices to work with, can choose the variables, see the characteristics, their distribution, … and then apply the appropriate cleaning, discretization and/or transformation rules (Map-Reduce rules).

inLab FIB has set up a technical team to support the aforementioned analytical and technological processes, made up of experts in Big Data and data mining, who will train the company’s technical staff to guarantee the continuity of the service beyond the duration of the project.