Skip directly to search

Skip directly to content

 

Data-Driven Impact: Don’t Settle for Less

 
 

Banking | Pierre Kovacs |
06 July 2022

This article was written in collaboration with Markus Boehme and Toby Dixon.

THE DATA UNIVERSE IS IN EXPANSION

Data-driven business models are at the top of the strategic agenda of many Corporate and Investment Banks (CIBs): analytics, machine learning (ML), client insight, hyper-personalisation, process mining, enhanced risk management, surveillance – to name a few. Data makes the difference: any solution is only as good as its input data. While data is ubiquitous, it lives in a universe in expansion. A data big bang has scattered data sources from the original on-premises mainframe across a cloud of microservices constellations, beyond the organisation’s frontier. Regional constraints, such as GDPR (General Data Protection Regulation), also pull apart some of the data in global organisations.

CIB data comes in all sorts of volume, velocity, and variety (the “3 Vs”): from a single transaction record to years of market data timeseries, from accounting batch reports to real-time risk exposure, from structured data to dark (matter?) data. Microservices with their dedicated storage and the fintech model with its highly interoperable systems, each focused on a specific business feature, will continue fragmenting the data universe.

Leveraging data comes with costs spread across acquisition, enhancement, storage, accessing, and processing. For example, market data is notoriously onerous to acquire and manipulate. AFME (Association for Financial Markets in Europe) recently published a report on “The Rising Cost of European Fixed Income Market Data”. At the same time, the UK’s FCA (Financial Conduct Authority) announced that it will review the costs of market data. There are numerous stories of multiple lines of business of the same bank paying twice for the same data, or a Value at Risk system in UAT (user acceptance testing) pulling several years of historical market data, or struggling to comply with licensing restrictions. Overall end-to-end costs of data are often underestimated at the design stage and have a habit of getting out of hand in live operation.

ADRIFT IN THE DATA SPACE

How do you engineer a data platform across different business lines, asset classes, front to back, across systems including SaaS (Software as a Service) third parties, in a way that is readily accessible to all end users, whether they are tech-savvy data scientists or “low code” analysts?

Several CIBs went through an evolutionary, ‘tag on and gradually improve’ approach, with on-premises data warehouses and then data lakes. However, the results were often disappointing. They provided limited data integration, scalability, and maintainability. While they made some data accessible, they didn’t reduce the underlying inefficiency and added to the cost base. More confusing yet, multiple approaches have emerged beyond the traditional centralised data warehouses, such as data mesh, data fabric, and data virtualisation. They are variations on the centre of gravity of the storage, serving layer, and governance. Assessing the maturity and impact of these approaches can be daunting.

These approaches ended up settling for less in their pursuit of keeping projects manageable. But with rare exceptions, they did not deliver the expected benefits, and the business users got increasingly frustrated.

REACH FOR THE STARS

It is time to tackle those challenges at a fundamental level: simultaneously architecting for end-to-end cost and business impact. It might at first feel like organising a trip to Mars. The right architecture, leveraging latest technology opportunities in a phased approach, makes this journey possible.

Third-party vendors, too, have replaced their data warehouses and adopted SaaS solutions to distribute their data. “Data marketplaces” are emerging as a simple way to discover and access data outside an organisation, from mere business calendars to market insights. Some vendors go a step further by offering to host all client data and become the central data platform, although with some major constraints.

A large asset manager recently planned to replace an on-premises Enterprise Data Management system with a state-of-the-art Cloud Data Platform, including a proprietary Operations Portal, while the Portfolio Management System and the associated data sources and processes are being replaced. The proposed solution, based on the integration of PaaS and SaaS components, provides an unprecedented agility to deal with the sheer number of data sources, while retaining full control over the operations.

The technology around data is still evolving quickly. Most vendor platforms have had a major update within the past twelve months. They are usually more integrated across the whole data chain (ingestion, storage, transformation, serving, data science), and they provide end-to-end governance, such as monitoring, data lineage, catalogue, and access control, and reduce the stitching effort.

The cloud has become the natural home of the modern data platforms. It is now accepted by clients and regulators. It provides the required elasticity to scale computing and storage separately. But this could be another quantum leap for organisations that have not yet adopted a cloud strategy.

AI is now powering several traditionally painful processes, such as cataloguing data, identifying outliers, pairing, and reconciling. This can reduce the need for a data steward and accelerate the work of the analysts. ML algorithms can assist the business end users, based on their interactions with reports, to be truly self-reliant without knowledge of SQL, data models, or even the data format. They can recommend relevant data, enrichment patterns, transformations, and cleansing.

THE RIGHT CREW WITH THE RIGHT FLIGHT PLAN

The data journey usually involves all applications in the firm (and some data sources outside your solar system), all types of users, and an array of recent technologies. It is crucial to have the right team and the right approach.

A client had been struggling for years with the governance of hundreds of user reports, the lack of accuracy and performance of regulatory MiFID reports, the limitations of their executive dashboard, or even the aggregation of investment positions data. The new platform simplified the reporting estate by 50% and added a robust monitoring; the new regulatory reports integrated more data sources for accuracy, and their generation speed increased tenfold; the management team had a user-friendly, detailed, and accurate dashboard that was generated ten times faster; a single source of truth was finally available to fuel analytics.

Furthermore, the right team is often multidisciplinary. In addition to the usual suspects, such as data engineers, data architects, and data analysts, other experts must support the multiple dimensions of a project. For example, a cloud architect can support the associated cloud migration; an industry SME (subject matter expert) will help navigate the business processes and the data semantic and ontology challenges; an API design expert will unlock data for other systems. Whilst getting the design right is of paramount importance, the team required to deliver on this continues this theme – the data will evolve almost as fast as the platform, and agile delivery with multi-disciplinary teams lends itself to the constant need for correcting course.

An experienced team will avoid the many pitfalls and apply best practices, advise on the options and trade-offs of each design approach, and take advantage of the latest technology and keep costs in mind.

Despite the many moving parts, the right flight plan can still deliver incremental value. For example, building a data platform from a simple storage and reporting platform to a data master and book of records, to an integration hub between systems, to an advanced machine learning sandpit.

Finally, the right flight plan will include post-landing aspects. It will be forward-looking to make sure there is a sound operating model to reap the expected benefits, such as the accessibility of high-quality data to all end users according to a clear governance, the reliability and adaptability of the platform when data sources change, and the capability to automate and develop advanced analytics.

DON’T SETTLE FOR LESS

The data challenge is well understood by now, both in terms of the opportunity it presents to organisations and the size of the task ahead of them to be able to take advantage. We are at an inflection point between these two competing forces; technology has made the necessary advances in the past five years to the point where it can be safely invested in and iterated on, whilst the size and complexity of the data we are all now required to manage will only continue to exponentially grow.

Those firms who address their data estate now will prosper – those who don’t will get left behind. Now is the right time for organisations who haven’t started, or who have tried and been disappointed, to future-proof their data platforms and position themselves for the future.

Pierre Kovacs

Banking & Capital Markets Industry Lead

Pierre is our Banking & Capital Markets Industry Lead based in London. He has spent 20+ years delivering systems from leadership positions at Investment Banks and Asset Managers. Prior to joining Endava, he was Chief Technology Innovation Officer at a fintech providing cross-asset, front-to-back office systems to hedge funds, investment banks, private banks, and energy trading firms. Over the summer of 2021, Pierre took a short break to complete the UK Ironman fitness competition in Bolton and the Ventouxman race in France.

 

Related Articles

  • 11 October 2022

    Buy vs. Build in Banking: Which Option is Right for You?

  • 23 August 2022

    5 Ways to Fix Your Data Spine in Banking

  • 31 August 2021

    Personalised Banking: How to Get Ahead of Ever-Changing Client Value Propositions

  • 13 July 2021

    The Transformation Trifecta: Cloud, Digital and Open Banking

  • 05 May 2021

    Artificial Intelligence: Where Does The Real Value Lie?

 

From This Author

  • 11 October 2022

    Buy vs. Build in Banking: Which Option is Right for You?

  • 23 August 2022

    5 Ways to Fix Your Data Spine in Banking

  • 28 February 2022

    Tackling CIB Legacy at its Core

Most Popular Articles

How Reverse Logistics are Turning Ecommerce Green
 

Innovation | Bogdan Tindeche | 29 November 2022

How Reverse Logistics are Turning Ecommerce Green

5 Things We Learned at World Aviation Festival 2022
 

Mobility | Vojin Rakonjac | 23 November 2022

5 Things We Learned at World Aviation Festival 2022

Cyber Security Incidents in Australia Highlight the Need for a Balance Between Risk and Innovation
 

Payments | David Marsh | 23 November 2022

Cyber Security Incidents in Australia Highlight the Need for a Balance Between Risk and Innovation

The Era of Ecosystems and the Rise of Open Insurance
 

Insurance Insights | Robert Anderson | 22 November 2022

The Era of Ecosystems and the Rise of Open Insurance

How Tech is Changing Sports Betting for the Better
 

Innovation | Andy Davies | 18 November 2022

How Tech is Changing Sports Betting for the Better

4 Ways Insurers Can Leverage Technology to Differentiate Themselves
 

Insurance Insights | Robert Anderson | 16 November 2022

4 Ways Insurers Can Leverage Technology to Differentiate Themselves

The future of banking in the Nordics – being digital and personal
 

Banking | Francis Hellawell | 16 November 2022

The future of banking in the Nordics – being digital and personal

Staying relevant in the buoyant cross-border payments market
 

Payments | Peter Theunis | 15 November 2022

Staying relevant in the buoyant cross-border payments market

3 Experts’ Insights on the Complicated Relationship Between Fintechs and Banks
 

Banking | Zoya Lieberman, CTP | 15 November 2022

3 Experts’ Insights on the Complicated Relationship Between Fintechs and Banks

 

Archive

  • 29 November 2022

    How Reverse Logistics are Turning Ecommerce Green

  • 23 November 2022

    5 Things We Learned at World Aviation Festival 2022

  • 23 November 2022

    Cyber Security Incidents in Australia Highlight the Need for a Balance Between Risk and Innovation

  • 22 November 2022

    The Era of Ecosystems and the Rise of Open Insurance

  • 18 November 2022

    How Tech is Changing Sports Betting for the Better

  • 16 November 2022

    4 Ways Insurers Can Leverage Technology to Differentiate Themselves

  • 16 November 2022

    The future of banking in the Nordics – being digital and personal

  • 15 November 2022

    Staying relevant in the buoyant cross-border payments market

  • 15 November 2022

    3 Experts’ Insights on the Complicated Relationship Between Fintechs and Banks

  • 09 November 2022

    How Can Banks Create a Secure, Optimised Cloud-Enabled Architecture?

  • 08 November 2022

    Tech is Good for You: How Wearable Edge Devices Changed Healthcare

  • 01 November 2022

    How Microservices Can Upgrade the Customer Experience

  • 25 October 2022

    How Technology Can Help Monitor the Circular Economy

  • 18 October 2022

    Why it’s time for banks to let go of legacy IT

  • 11 October 2022

    Buy vs. Build in Banking: Which Option is Right for You?

  • 04 October 2022

    The Rise of Super Apps: How Banks Can Compete

  • 27 September 2022

    AI Art in Game Production – an XDS 2022 Table Discussion

  • 20 September 2022

    Payments Data Monetisation is Key to Driving Sustainable Growth

  • 13 September 2022

    Navigating the Healthcare Ecosystem

  • 30 August 2022

    hey y’all! I’m Ashley Grant

  • 23 August 2022

    5 Ways to Fix Your Data Spine in Banking

  • 16 August 2022

    De-risking Digitalisation

  • 09 August 2022

    hi, I’m Brian Estep

  • 02 August 2022

    hey! I’m Lia Rollman

  • 19 July 2022

    The New Ways of Issuing Cards

  • 12 July 2022

    Scores on the Door: Rating Autonomous Vehicles

  • 06 July 2022

    Data-Driven Impact: Don’t Settle for Less

  • 06 July 2022

    We’re in Nottingham – a Q&A on Endava’s New Delivery Centre in the UK

  • 05 July 2022

    hey, I’m Chris Hart

  • 28 June 2022

    Platforms: a Blessing or a Curse?

  • 23 June 2022

    A Payments View on Marketplaces – How to Be(come) Successful

  • 21 June 2022

    Intelligent Commercial Underwriting

  • 14 June 2022

    The Future of Supply Chain: What’s Next?

  • 31 May 2022

    The Future of Autonomous Vehicles in T&L

  • 26 May 2022

    hello! I’m Hannah McCarthy

  • 24 May 2022

    Going Native: Why Cloud-Native Services are Essential

  • 19 May 2022

    How to Tackle Legacy – Breaking Down Walls Between Change and Run

  • 17 May 2022

    Advantages of a Yard Management System

  • 12 May 2022

    Are Phones About to Become the New POS Terminals?

  • 10 May 2022

    The Digital Economy is an Upgrade of Smart Cities and Communities

  • 05 May 2022

    hello! I’m Sumita Davé

  • 03 May 2022

    Physical Automation in the T&L Industry

  • 28 April 2022

    zdravo! I’m Andrej Kotar

  • 26 April 2022

    Open Banking in the US

  • 20 April 2022

    hello! I’m Paul Maguire

  • 19 April 2022

    Digital Automation in the T&L Industry

  • 12 April 2022

    How Do Banks Embrace Embedded Finance – Have the Fintechs Already Won?

  • 06 April 2022

    ESG Data Architecture is a Business Imperative – How to Get Started

  • 05 April 2022

    hi! I am Roy Murphy

  • 05 April 2022

    Modernizing the Shipping and Cargo Process

  • 30 March 2022

    The Metaverse Evolution and Learning from the Games Industry

  • 29 March 2022

    Do Androids Dream of Trading Electric Sheep for Digital Wood? An Introduction to Automated Game Design

  • 23 March 2022

    Real-Time Payments in Australia – Why Corporates Should Get on Board

  • 22 March 2022

    Current Challenges in the Transportation & Logistics Industry

  • 16 March 2022

    bok! I’m Sanja Cvetkovic

  • 15 March 2022

    Rapidly Transforming: Healthtech Trends in 2022

  • 08 March 2022

    How to Digitize Warehouses and Distribution Centers

  • 01 March 2022

    Top Challenges in Warehouse and Distribution Centers

  • 28 February 2022

    Tackling CIB Legacy at its Core

  • 23 February 2022

    salut! I am Isabela Buhai

  • 22 February 2022

    4 Buy Now Pay Later Trends Set to Disrupt the Industry

  • 15 February 2022

    salut! I’m Natalia Ciobanu

  • 14 February 2022

    Product-Led Innovation – a Q&A with Joe Dunleavy

  • 01 February 2022

    Buy Now Pay Later: Will Regulation Burst the Bubble?

  • 31 January 2022

    Innovation Will Spur Ireland’s Race to the Top

  • 28 January 2022

    The Value of Digital and Automation in the Product Returns Process

  • 26 January 2022

    Virtually Disrupted? Keeping Pace with Accelerating Customer Expectations

  • 19 January 2022

    The 3 Big Ps in Modern Insurance: Personalisation, Prediction and Prevention

  • 18 January 2022

    An Introduction to Mobility as a Service in the US

  • 12 January 2022

    Buy or Build? A Game-Changing Question in Insurance

  • 12 January 2022

    hello! I’m Paul Willoughby

  • 11 January 2022

    Payment Service Providers 2.0

  • $name

We are listening

How would you rate your experience with Endava so far?

We would appreciate talking to you about your feedback. Could you share with us your contact details?