Select Page
Mediolanum Investment Funds

Delivering an enterprise data platform for Mediolanum’s rapidly growing business.

Project at a glance

Industry:

FSI

Technology practice:

Data Insights

Challenge:

Deliver an enterprise data platform for Mediolanum’s rapidly growing business.

Technology products:

Microsoft Cloud Suite, Azure Data Factory, Azure Data Pipelines, Azure Event Hub, Snowflake data platform

Business transformation delivered:

  • The business can scale to meet demand without worrying about data volume, complexity and simultaneous nature of the data loads they need to process.

  • The framework is designed to allow Mediolanum to build and execute jobs with either atomic pipelines or pipelines aggregated into wrapper pipelines which also scales with the growth of the business.

  • Mediolanum now have a highly scalable, highly flexible event driven cloud enterprise data architecture which solves their immediate data challenges and future- proofs the business.

Challenge

Deliver a state of the art, highly scalable enterprise cloud architecture to support Mediolanum’s rapidly growing business.

Mediolanum had a on-premise SQL Server data warehouse solution which included a bespoke code based data loading and transformation process. The data load process which was already very manual also became unreliable and completely lacked any strong data quality, data governance and policy control capability. Given the regulated funds management industry standards and the precise requirements of this highly competitive business combined with Mediolanum’s ambitious growth targets, the current system simply became untenable. 

Approach

Build the core target cloud-based architecture entirely on the Microsoft Cloud suite for enterprise data and complemented by Informatica and Snowflake.

Working closely with Mediolanum we designed a completely new architecture to support the scale, complexity and growth demands of the business. We completed proof of concepts to test the optimum combination of Microsoft and Snowflake capability.

The volume and scheduling of the inbound data files for processing from the data providers was a key consideration in the design. We also needed to architect a solution which would provide the business users with the reports and data they needed to run the business. Financial Services is a complex and competitive industry and the solution needed to meet the expectations of both the Mediolanum senior management team, their parent organisation and their customers.

The solution uses the latest Microsoft enterprise data components including Azure Data Factory to handle the code translation, path optimization and execution of the data flow jobs. We architected the solution based on an ELT approach using Azure data pipelines. The processing framework is an event driven approach where events trigger transformations executed in parallel to meet the challenging business demands. The transformations in the framework are highly interdependent requiring precise instructions from the orchestration framework. All dependencies between transformations are defined in the framework metadata. We designed an optimum combination of Azure Event Hub and Grid technologies to orchestrate the processing of the data including into the Snowflake data warehouse. Snowflake transformations are embedded in complex but highly efficient stored procedures. Execution of the stored procedures and subsequent Informatica data governance processes are managed through ADF pipelines.

Results

A highly scalable, highly flexible event-driven cloud enterprise data platform

The combination of Client Solutions’ experience and skills together with the enterprise data technology from Microsoft, Snowflake and Informatica enabled Mediolanum to achieve its goals and meet the data demands of their industry, management and customers.

A fully parallel processing architecture means the business can scale to meet demand without worrying about data volume, complexity and simultaneous nature of the data loads they need to process. The framework itself is designed to allow Mediolanum to build and execute jobs with either atomic pipelines or pipelines aggregated into wrapper pipelines which also scales with the growth of the business. All logging is captured and written out to DataDog.

Mediolanum now have a highly scalable, highly flexible event driven cloud enterprise data architecture which solves their immediate data challenges and future proofs the business. The combination of Client Solutions’ experience and Microsoft technologies has fully enabled the Digital Transformation program of work.