Big Data Analytics Lab

This project was carried out with a multinational based in Barcelona with the aim of launching a pilot Big Data platform based on Open Source tools to facilitate and streamline support processes analysis and processing of data in order to improve their business process.

The project focuses on improving a very specific use case, which will serve as a starting point to define and implement a reference architecture.

In defining the reference architecture it is where the different technological components are specified. These technological components will be Big Data tools, you have to choose carefully depending on the structure of the data and queries which we expect to be made.

The project starts with the study of the origin data, which allows us to make an initial selection of Big Data tools that will serve us best. Once selected, we value the various tools, including some benchmarkings, to determine the speed of each chosen solution.

Then, we create an ontology of the data so that data analysts of the company, who need data arrays to work, can choose the variables, see the features, see the distribution,.... and then apply rules of cleanliness, discretization and/or processing (Map-Reduce type rules).

InLab FIB has constituted a technical team to support the above analytical and technological processes, consisting of experts in Big Data and data mining, who will train technical staff of the company to ensure continuity of service beyond the project duration .