<img height="1" width="1" style="display:none;" alt="" src="https://px.ads.linkedin.com/collect/?pid=4958233&amp;fmt=gif">
 
RSS Feed

Strategy | Pierre Kovacs |
06 July 2022

This article was written in collaboration with Markus Boehme and Toby Dixon.

THE DATA UNIVERSE IS IN EXPANSION

Data-driven business models are at the top of the strategic agenda of many Corporate and Investment Banks (CIBs): analytics, machine learning (ML), client insight, hyper-personalisation, process mining, enhanced risk management, surveillance – to name a few. Data makes the difference: any solution is only as good as its input data. While data is ubiquitous, it lives in a universe in expansion. A data big bang has scattered data sources from the original on-premises mainframe across a cloud of microservices constellations, beyond the organisation’s frontier. Regional constraints, such as GDPR (General Data Protection Regulation), also pull apart some of the data in global organisations.

CIB data comes in all sorts of volume, velocity, and variety (the “3 Vs”): from a single transaction record to years of market data timeseries, from accounting batch reports to real-time risk exposure, from structured data to dark (matter?) data. Microservices with their dedicated storage and the fintech model with its highly interoperable systems, each focused on a specific business feature, will continue fragmenting the data universe.

Leveraging data comes with costs spread across acquisition, enhancement, storage, accessing, and processing. For example, market data is notoriously onerous to acquire and manipulate. AFME (Association for Financial Markets in Europe) recently published a report on “The Rising Cost of European Fixed Income Market Data”. At the same time, the UK’s FCA (Financial Conduct Authority) announced that it will review the costs of market data. There are numerous stories of multiple lines of business of the same bank paying twice for the same data, or a Value at Risk system in UAT (user acceptance testing) pulling several years of historical market data, or struggling to comply with licensing restrictions. Overall end-to-end costs of data are often underestimated at the design stage and have a habit of getting out of hand in live operation.

ADRIFT IN THE DATA SPACE

How do you engineer a data platform across different business lines, asset classes, front to back, across systems including SaaS (Software as a Service) third parties, in a way that is readily accessible to all end users, whether they are tech-savvy data scientists or “low code” analysts?

Several CIBs went through an evolutionary, ‘tag on and gradually improve’ approach, with on-premises data warehouses and then data lakes. However, the results were often disappointing. They provided limited data integration, scalability, and maintainability. While they made some data accessible, they didn’t reduce the underlying inefficiency and added to the cost base. More confusing yet, multiple approaches have emerged beyond the traditional centralised data warehouses, such as data mesh, data fabric, and data virtualisation. They are variations on the centre of gravity of the storage, serving layer, and governance. Assessing the maturity and impact of these approaches can be daunting.

These approaches ended up settling for less in their pursuit of keeping projects manageable. But with rare exceptions, they did not deliver the expected benefits, and the business users got increasingly frustrated.

REACH FOR THE STARS

It is time to tackle those challenges at a fundamental level: simultaneously architecting for end-to-end cost and business impact. It might at first feel like organising a trip to Mars. The right architecture, leveraging latest technology opportunities in a phased approach, makes this journey possible.

Third-party vendors, too, have replaced their data warehouses and adopted SaaS solutions to distribute their data. “Data marketplaces” are emerging as a simple way to discover and access data outside an organisation, from mere business calendars to market insights. Some vendors go a step further by offering to host all client data and become the central data platform, although with some major constraints.

A large asset manager recently planned to replace an on-premises Enterprise Data Management system with a state-of-the-art Cloud Data Platform, including a proprietary Operations Portal, while the Portfolio Management System and the associated data sources and processes are being replaced. The proposed solution, based on the integration of PaaS and SaaS components, provides an unprecedented agility to deal with the sheer number of data sources, while retaining full control over the operations.

The technology around data is still evolving quickly. Most vendor platforms have had a major update within the past twelve months. They are usually more integrated across the whole data chain (ingestion, storage, transformation, serving, data science), and they provide end-to-end governance, such as monitoring, data lineage, catalogue, and access control, and reduce the stitching effort.

The cloud has become the natural home of the modern data platforms. It is now accepted by clients and regulators. It provides the required elasticity to scale computing and storage separately. But this could be another quantum leap for organisations that have not yet adopted a cloud strategy.

AI is now powering several traditionally painful processes, such as cataloguing data, identifying outliers, pairing, and reconciling. This can reduce the need for a data steward and accelerate the work of the analysts. ML algorithms can assist the business end users, based on their interactions with reports, to be truly self-reliant without knowledge of SQL, data models, or even the data format. They can recommend relevant data, enrichment patterns, transformations, and cleansing.

THE RIGHT CREW WITH THE RIGHT FLIGHT PLAN

The data journey usually involves all applications in the firm (and some data sources outside your solar system), all types of users, and an array of recent technologies. It is crucial to have the right team and the right approach.

A client had been struggling for years with the governance of hundreds of user reports, the lack of accuracy and performance of regulatory MiFID reports, the limitations of their executive dashboard, or even the aggregation of investment positions data. The new platform simplified the reporting estate by 50% and added a robust monitoring; the new regulatory reports integrated more data sources for accuracy, and their generation speed increased tenfold; the management team had a user-friendly, detailed, and accurate dashboard that was generated ten times faster; a single source of truth was finally available to fuel analytics.

Furthermore, the right team is often multidisciplinary. In addition to the usual suspects, such as data engineers, data architects, and data analysts, other experts must support the multiple dimensions of a project. For example, a cloud architect can support the associated cloud migration; an industry SME (subject matter expert) will help navigate the business processes and the data semantic and ontology challenges; an API design expert will unlock data for other systems. Whilst getting the design right is of paramount importance, the team required to deliver on this continues this theme – the data will evolve almost as fast as the platform, and agile delivery with multi-disciplinary teams lends itself to the constant need for correcting course.

An experienced team will avoid the many pitfalls and apply best practices, advise on the options and trade-offs of each design approach, and take advantage of the latest technology and keep costs in mind.

Despite the many moving parts, the right flight plan can still deliver incremental value. For example, building a data platform from a simple storage and reporting platform to a data master and book of records, to an integration hub between systems, to an advanced machine learning sandpit.

Finally, the right flight plan will include post-landing aspects. It will be forward-looking to make sure there is a sound operating model to reap the expected benefits, such as the accessibility of high-quality data to all end users according to a clear governance, the reliability and adaptability of the platform when data sources change, and the capability to automate and develop advanced analytics.

DON’T SETTLE FOR LESS

The data challenge is well understood by now, both in terms of the opportunity it presents to organisations and the size of the task ahead of them to be able to take advantage. We are at an inflection point between these two competing forces; technology has made the necessary advances in the past five years to the point where it can be safely invested in and iterated on, whilst the size and complexity of the data we are all now required to manage will only continue to exponentially grow.

Those firms who address their data estate now will prosper – those who don’t will get left behind. Now is the right time for organisations who haven’t started, or who have tried and been disappointed, to future-proof their data platforms and position themselves for the future.

Pierre Kovacs

Banking & Capital Markets Industry Lead

Pierre is our Banking & Capital Markets Industry Lead based in London. He has spent 20+ years delivering systems from leadership positions at Investment Banks and Asset Managers. Prior to joining Endava, he was Chief Technology Innovation Officer at a fintech providing cross-asset, front-to-back office systems to hedge funds, investment banks, private banks, and energy trading firms. Over the summer of 2021, Pierre took a short break to complete the UK Ironman fitness competition in Bolton and the Ventouxman race in France.

 

From This Author

  • 02 November 2023

    What’s Shaping the Future of Capital Markets? 6 Takeaways from OPTIC

  • 12 July 2023

    Regtech - Necessary evil or competitive edge?

  • 07 February 2023

    Supercharging Wealth Management with Hyper-Personalisation

  • 11 October 2022

    Buy vs. Build in Banking: Which Option is Right for You?

  • 23 August 2022

    5 Ways to Fix Your Data Spine in Banking

 

Archive

  • 28 November 2023

    Moving Towards Global AI Regulation, an Update

  • 24 November 2023

    Marketplace Models and the Future of Airline Retailing

  • 21 November 2023

    Unlearn Churn: How Predictive Analytics Can Improve Retail Customer Retention

  • 16 November 2023

    Hi, I’m Matt Cloke

  • 15 November 2023

    How Microbetting Is Creating a More Engaging Fan Experience

  • 09 November 2023

    Learning the ecosystem lessons

  • 03 November 2023

    10 Groundbreaking Edtech Trends Revolutionizing the Future of Education

  • 02 November 2023

    What’s Shaping the Future of Capital Markets? 6 Takeaways from OPTIC

  • 31 October 2023

    Using Tech to Maximize the Impact of Major Sporting Events

  • 30 October 2023

    How to Streamline Your Retail Operations Through Selective Stocking

  • 19 October 2023

    Why Retail Margins are Tightening (and How to Protect Yours)

  • 13 October 2023

    Why Ground Operations Need Digital Transformation to Cope with Demand

  • 11 October 2023

    MWC Las Vegas: 8 Key Takeaways in Telecommunications

  • 09 October 2023

    Going Green: 5 Ways to Enjoy Leisure Activities Responsibly

  • 06 October 2023

    How Airlines Can Win a New Generation of Passengers

  • 26 September 2023

    Who Wins Most from Healthcare’s AI Transformation?

  • 21 September 2023

    Why Loyalty Programs Matter More Than Ever in Retail

  • 20 September 2023

    What Businesses Need to Start Innovating

  • 14 September 2023

    The Spark That Drives Machine Learning to Shine

  • 08 September 2023

    Why Customer Experience is at the Heart of Supply Chain Management

  • 07 September 2023

    How Offer and Order Management Systems Are Expanding The Aviation Business Model

  • 25 August 2023

    Tuning Out the Noise: Picking the AI for Practical Business Impact

  • 24 August 2023

    Resetting the Status Quo – How Banks Can Overcome Payments Challenges

  • 17 August 2023

    Opening Lap: An Endava and Toyota Racing Development Q&A

  • 17 August 2023

    The AI Boost in Gaming: Gameplay, Narrative and Production

  • 08 August 2023

    How Healthtech Simplifies and Secures Payments Processing

  • 14 July 2023

    Streamlining Digital Media Supply Chains with Generative AI

  • 13 July 2023

    4 Areas for Financial Institutions to Consider When Starting Out with Real-Time Payments

  • 12 July 2023

    Regtech - Necessary evil or competitive edge?

  • 07 July 2023

    Prime and Thrive: 3 Steps to Build Your International Payments Model

  • 06 July 2023

    Real-time Fraud – Solving the Virtual Pocket-Picking Problem

  • 29 June 2023

    Salut! I’m Radu Orghidan

  • 14 June 2023

    Debunking the Myths on Generative AI: What Is the Reality Behind the Most Common AI Misconceptions?

  • 31 May 2023

    The Time Is Now to Start Thinking About Real-Time Payments

  • 25 May 2023

    An Anatomy of the Data-Driven Retail Supply Chain

  • 23 May 2023

    BNPL regulation to protect consumers and control third-party lenders

  • 16 May 2023

    Salut! I'm Adriana Calomfirescu

  • 15 May 2023

    Hi, I'm David Boast

  • 12 May 2023

    The Business Impact of Fan Engagement: How to Leverage Technology to Improve Loyalty

  • 09 May 2023

    Staying Relevant - Why Merchants should embrace alternative Payments methods

  • 02 May 2023

    How IoT is changing Insurance

  • 26 April 2023

    A Veteran Game Developer's Perspective on Tool Development

  • 24 April 2023

    How Digital Ecosystems Enhance the Healthcare Experience

  • 21 April 2023

    Green Machines How Tech can Help Companies Hit Net-Zero Targets

  • 20 April 2023

    The Role of People and Technology in the Future of Underwriting

  • 19 April 2023

    Media 2030: Why Advertisers And Publishers Are Racing To Find New Strategies

  • 18 April 2023

    Alright, I’m Adrian Sutherland

  • 14 April 2023

    How Synthetic Data Could Solve Patient Privacy Dilemma

  • 11 April 2023

    Payments Makes The World Go Round

  • 06 April 2023

    Higher Fidelity Good Outcomes Harnessing FCAs Consumer Duty

  • 05 April 2023

    AI in Pharma: How Machine Learning is Transforming Drug Development

  • 04 April 2023

    Hello! I’m Leane Collins

  • 31 March 2023

    The Dos and Donts of Carve Outs Private Equity

  • 30 March 2023

    Cage Of Reason: Fca's New Consumer Duty Heralds The Rise Of The 'Reasonable Insurer'

  • 28 March 2023

    A Legal View on the Ownership and Future of AI-Generated Works

  • 24 March 2023

    Championing Women In Tech

  • 23 March 2023

    5 Ways Capital Markets Companies Can Ensure Resilient Operations

  • 15 March 2023

    Buenas! I’m Leticia Chajchir

  • 14 March 2023

    4 Ways To Improve Customers’ E-commerce Search Experience

  • 28 February 2023

    4 Healthcare Innovations that Can Benefit People and Profit

  • 21 February 2023

    Hey, I'm Lewis Brown

  • 17 February 2023

    Top Considerations for Financial Services Providers entering th Cross-Border Payments Space

  • 13 February 2023

    Better Together Harnessing The Power Of Digital Ecosystems

  • 09 February 2023

    What to Include in a Customer Re-Engagement Content Library

  • 07 February 2023

    Supercharging Wealth Management with Hyper-Personalisation

  • 02 February 2023

    How Innovating the Insurance Customer Journey creates a Competitive Advantage

  • 30 January 2023

    G'Day, I'm David Marsh

  • 26 January 2023

    Empowering Underwriting and Unlocking Revenue with Legacy Insurance Data Sets

  • 24 January 2023

    Four Stakeholders who win the most when Healthcare innovates

  • 23 January 2023

    Journey to the Centre of the Cloud with AWS - Part 3

  • 20 January 2023

    Journey to the Centre of the Cloud with AWS - Part 2

  • 18 January 2023

    Journey to the Centre of the Cloud with AWS - Part 1

  • 17 January 2023

    The 4 Most Common Mistakes in Retail Site Design

  • 13 January 2023

    Boost and bolster your innovation. Three tips to help get it to the next level

  • 10 January 2023

    5 Questions in Smart Energy that will define the Net Zero Transition

  • 19 December 2022

    Looking ahead and helping our customers do the same

  • 16 December 2022

    Stepping forward - The State of Cross-Border Payments in Southeast Asia

  • 14 December 2022

    Tech and Tinsel - Another Holiday Q&A with some of our Execs

  • 13 December 2022

    Why should Payment Service Providers be thinking about adding an ISV?

  • 07 December 2022

    How AI and Automation are revolutionising microscopy

  • 07 December 2022

    Venturing into the Metaverse to build an Innovative Bridge to Our People

  • 05 December 2022

    An Australian Eye on the Global Effort to Improve Cross-Border Payments

  • 29 November 2022

    How Reverse Logistics are Turning E-commerce Green

  • 23 November 2022

    5 things we learned at World Aviation Festival 2022

  • 23 November 2022

    Cyber Security Incidents in Australia Highlight the Need for a Balance Between Risk and Innovation

  • 22 November 2022

    The Era of Ecosystems and the Rise of Open Insurance

  • 18 November 2022

    How Tech is changing Sports betting for the better

  • 16 November 2022

    4 Ways Insurers Can Leverage Technology to Differentiate Themselves

  • 16 November 2022

    The Future of Banking in the Nordics - Being Digital and Personal

  • 15 November 2022

    Staying Relevant in the Buoyant Cross-Border Payments Market

  • 15 November 2022

    3 Experts' Insights on the Complicated Relationship between Fintechs and Banks

  • 09 November 2022

    How can banks create a secure, optimised cloud-enabled architecture?

  • 08 November 2022

    Tech is Good for you: How Wearable Edge Devices Changed Healthcare

  • 01 November 2022

    How Microservices can upgrade the Customer Experience

  • 25 October 2022

    How Technology can help Monitor the Circular Economy

  • 18 October 2022

    Why it's Time for Banks to let go of Legacy IT

  • 11 October 2022

    Buy vs. Build in Banking: Which Option is Right for You?

  • 04 October 2022

    The Rise of Super Apps: How Banks can compete

  • 28 September 2022

    AI Art in Game Production – an XDS 2022 Table Discussion

  • 20 September 2022

    Payments Data Monetisation is Key to Driving Sustainable Growth

  • 13 September 2022

    Navigating the Healthcare Ecosystem

  • 30 August 2022

    hey y’all! I’m Ashley Grant

  • 23 August 2022

    5 Ways to Fix Your Data Spine in Banking

  • 16 August 2022

    De-risking Digitalisation

  • 09 August 2022

    hi, I’m Brian Estep

  • 02 August 2022

    hey! I’m Lia Rollman

  • 19 July 2022

    The New Ways of Issuing Cards

  • 12 July 2022

    Scores on the Door: Rating Autonomous Vehicles

  • 06 July 2022

    We’re in Nottingham – a Q&A on Endava’s New Delivery Centre in the UK

  • 06 July 2022

    Data-Driven Impact: Don’t Settle for Less

  • 06 July 2022

    hey, I’m Chris Hart

  • 28 June 2022

    Platforms: a Blessing or a Curse?

  • 23 June 2022

    A Payments View on Marketplaces – How to Be(come) Successful

  • 21 June 2022

    Intelligent Commercial Underwriting

  • 14 June 2022

    The Future of Supply Chain: What’s Next?

  • 31 May 2022

    The Future of Autonomous Vehicles in T&L

  • 27 May 2022

    Hello! I'm Hannah McCarthy

  • 24 May 2022

    Going Native: Why Cloud-Native Services are Essential

  • 19 May 2022

    How to Tackle Legacy – Breaking Down Walls Between Change and Run

  • 17 May 2022

    Advantages of a Yard Management System

  • 13 May 2022

    Are Phones About to Become the New POS Terminals?

  • 10 May 2022

    The Digital Economy is an Upgrade of Smart Cities and Communities

  • 05 May 2022

    hello! I’m Sumita Davé

  • 03 May 2022

    Physical Automation in the T&L Industry

  • 28 April 2022

    zdravo! I’m Andrej Kotar

  • 26 April 2022

    Open Banking in the US

  • 20 April 2022

    hello! I’m Paul Maguire

  • 19 April 2022

    Digital Automation in the T&L Industry

  • 12 April 2022

    How Do Banks Embrace Embedded Finance – Have the Fintechs Already Won?

  • 06 April 2022

    ESG Data Architecture is a Business Imperative – How to Get Started

  • 05 April 2022

    hi! I am Roy Murphy

  • 05 April 2022

    Modernizing the Shipping and Cargo Process

  • 30 March 2022

    The Metaverse Evolution and Learning from the Games Industry

  • 30 March 2022

    Do Androids Dream of Trading Electric Sheep for Digital Wood? An Introduction to Automated Game Design

  • 23 March 2022

    Real-Time Payments in Australia – Why Corporates Should Get on Board

  • 22 March 2022

    Current Challenges in the Transportation & Logistics Industry

  • 16 March 2022

    bok! I’m Sanja Cvetkovic

  • 15 March 2022

    Rapidly Transforming: Healthtech Trends in 2022

  • 08 March 2022

    How to Digitize Warehouses and Distribution Centers

  • 01 March 2022

    Top Challenges in Warehouse and Distribution Centers

  • 28 February 2022

    Tackling CIB Legacy at its Core

  • 23 February 2022

    salut! I am Isabela Buhai

  • 22 February 2022

    4 Buy Now Pay Later Trends Set to Disrupt the Industry

  • 15 February 2022

    salut! I’m Natalia Ciobanu

  • 14 February 2022

    Product-Led Innovation – a Q&A with Joe Dunleavy

  • 02 February 2022

    Buy Now Pay Later: Will Regulation Burst the Bubble?

  • 31 January 2022

    Innovation Will Spur Ireland’s Race to the Top

  • 28 January 2022

    The Value of Digital and Automation in the Product Returns Process

  • 26 January 2022

    Virtually Disrupted? Keeping Pace with Accelerating Customer Expectations

  • 19 January 2022

    The 3 Big Ps in Modern Insurance: Personalisation, Prediction and Prevention

  • 19 January 2022

    An Introduction to Mobility as a Service in the US

  • 12 January 2022

    hello! I’m Paul Willoughby

  • 12 January 2022

    Buy or Build? A Game-Changing Question in Insurance

  • 11 January 2022

    Payment Service Providers 2.0

  • 21 December 2021

    Making a Positive Impact Through Giving

  • 14 December 2021

    From Global Pandemic to Holiday Spirit – a Q&A With Some of Our Senior Execs

  • 07 December 2021

    Hand in Hand with Artificial Intelligence in the Energy Sector

  • 03 December 2021

    Evolving Digital Self-Service in Insurance

  • 29 November 2021

    zdravo! I’m Ilija Gospodinov

  • 24 November 2021

    yes folks, I’m Joe Dunleavy

  • 09 November 2021

    hi there! I’m Tony Whitehorn

  • 03 November 2021

    Operating Responsibly for Future Success

  • 02 November 2021

    Leveraging ESG Data to Grow Your Business

  • 26 October 2021

    Smart Tech: Providing the Visibility Supply Chains Need

  • 12 October 2021

    hello! I’m Scott Harkey

  • 05 October 2021

    How to Improve Intelligent Energy Storage Systems Using AI

  • 28 September 2021

    Data-Driven Insurance

  • 21 September 2021

    hi y’all! I’m Antony Francis

  • 14 September 2021

    Once Upon a Time … in Payments

  • 31 August 2021

    Personalised Banking: How to Get Ahead of Ever-Changing Client Value Propositions

  • 17 August 2021

    RPA: Using Robots to Streamline Processes

  • 10 August 2021

    The Inclusive Workplace of the Future – a Q&A with Asif Sadiq MBE

  • 03 August 2021

    hello! I’m Elisabeth Bradley

  • 27 July 2021

    How the Board Game Catan Conquered the Digital World

  • 13 July 2021

    The Transformation Trifecta: Cloud, Digital and Open Banking

  • 06 July 2021

    How to Future-Proof the Digital Retail Experience

  • 23 June 2021

    hi! I’m Thomas Bedenk

  • 17 June 2021

    Hello! I’m Adrian Bugaian

  • 18 May 2021

    4 Techniques to Fix Digital Breakages in the Supply Chain – Part 2

  • 11 May 2021

    Phygital in Automotive: Bridging the Gap Between Physical and Digital – Part 2

  • 05 May 2021

    Artificial Intelligence: Where Does The Real Value Lie?

  • 27 April 2021

    4 Techniques to Fix Digital Breakages in the Supply Chain – Part 1

  • 20 April 2021

    Phygital in Automotive: Bridging the Gap Between Physical and Digital – Part 1

  • 14 April 2021

    What ‘We Care’ Means at Endava – a Q&A on Sustainability with our CEO

  • 08 April 2021

    Before Commission / After Digitisation – a Pivotal Era for Australian Payments

  • 06 April 2021

    Insurance Insights: Low Code

  • 30 March 2021

    Insurance Insights: Intelligent Underwriting Workbench

  • 23 March 2021

    The Challenge of Technology is Not Technology

  • 18 March 2021

    Supporting and Empowering Women in Tech

  • 16 March 2021

    Insurance Insights: Customer Retention & Cross-Selling

  • 09 March 2021

    Insurance Insights: Cloud Migration

  • 02 March 2021

    How to Improve Interoperability in Healthcare

  • 23 February 2021

    Insurance Insights: Data Exploitation

  • 16 February 2021

    Insurance Insights: Open Insurance

  • 11 February 2021

    Mapping the Future Applications of Artificial Intelligence

  • 18 December 2020

    Celebrating 20 Years of Endava – with Julian Bull

  • 15 December 2020

    Insurance Industry Trends from DIA Prime Time

  • 08 December 2020

    Celebrating 20 Years of Endava – with Rob Machin

  • 04 December 2020

    Trends in the Automotive Industry for 2021

  • 25 November 2020

    Approaching 2021 – Technology Becomes the Business

OLDER POSTS