Pandemic-induced disruptions, evolving consumer behaviour, and extreme competition have made hybrid and multi-cloud environments the new normal of computing. 80% of organisations across the world have already adopted a hybrid cloud strategy, and 89% a multi-cloud strategy, according to Flexera’s 2022 State of the Cloud Report. In terms of spending, Gartner reported that IT spending in APAC for cloud services is forecasted to be more than $116 billion by 2024.
Highly controllable, easily scalable and cost-effective, these architectures allow users to freely pick and choose individual cloud offerings to suit almost any business need. The ease at which employees can share and access data with a hybrid cloud encourages a data-driven culture and helps enterprises accelerate time to insight. A hybrid data platform grants enterprises the ability to access and analyse data across public and private clouds, and on-premises. It also helps fuel growth while still providing security and control over their data.
Many businesses new to the multi and hybrid cloud often rush through setting up environments without a proper enterprise data management strategy that is organisation-wide, integrated, governed, and secure, seeking to quickly enjoy efficiency gains or seize business opportunities before they disappear.
Ready or not, the rise of hybrid and multi-cloud is here, bringing along numerous business opportunities - but also new challenges that threaten to derail a company’s digital transformation efforts.
Challenge #1: Silos and security issues
As enterprises rush to the cloud, those uninformed of data integration challenges and disadvantages of closed-source ecosystems often find their data siloed behind multiple walled gardens. These silos hinder hybrid and multi-cloud innovation and prevent stakeholders from extracting meaningful business insights from data.
Silos and closed-source technologies also make data governance and security across hybrid and multi-cloud environments a challenge. The process of integrating technologies with proprietary data catalogues and security policies can be arduous and takes time as well as significant resources while introducing risk.
Silos and proprietary security also limit businesses' visibility of their data lineage, preventing enterprises from establishing proper audit trails and managing risk, making compliance challenging and inviting cybersecurity threats. ​​
Challenge #2: Cost factors
Though hybrid and multi-cloud architectures have the potential to reduce costs considerably, ironically, they can also contribute significantly to overheads when mismanaged. Silos and a lack of data governance and visibility often lead to cloud sprawl when businesses lose track of where applications are hosted or when applications are not being run efficiently.
Some cloud services are priced based on the consumption of compute resources, and others may charge by data scanned per query basis or bandwidth. Businesses unfamiliar with the diverse variety of pricing, fee and infrastructure sizing models used by different vendors often end up racking up astronomical costs as they struggle to stop sprawl.
How can enterprises overcome the challenges?
When left unchecked, silos, data governance and security issues, and cost overruns can cripple critical services like content delivery, enterprise resource planning, and customer relationship management - causing downtime and limiting the business’s competitiveness.
Therefore, businesses must stop treating hybrid and multi-cloud as an afterthought and adopt an enterprise data strategy that clearly outlines how the data architecture should be designed to support business and IT goals, manage costs, and enforce data governance and security.
Source: Cloudera Enterprise Data Maturity Report, 2022
A recent report and survey by Vanson Bourne and Cloudera revealed that businesses with an enterprise strategy showed more resilience since the pandemic's start. 64% of senior decision-makers surveyed believed their businesses coped very well due to having an enterprise strategy in place for more than a year.
Consider an enterprise data strategy
To break free of silos, companies should ensure that their enterprise data strategy and architecture facilitate the rapid, free flow of data between all environments. This can be done by carefully picking and integrating a best-of-breed suite of compatible technologies in an easily manageable platform.
Open-source technologies like Kubernetes and Apache Spark offer excellent compatibility, interoperability, and control, allowing businesses to simultaneously store, manage and secure data across multiple cloud vendors. They also enable enterprises to avoid vendor lock-in and benefit from open-source ecosystem partnerships and rapid community innovation.
To ensure proper data governance, the businesses’ enterprise data strategy should use a unified security model to enforce a consistent set of security and data governance policies across all on-premises and cloud environments.
While open-source technologies help businesses gain better control over which workloads are run and what data can be accessed, a unified security model helps organisations apply fine-grained security policies with a full data lineage and audit trail crucial for ensuring data integrity and compliance no matter where data resides.
Review your existing data strategy
Enterprises must conduct a comprehensive data strategy review with all stakeholders to ensure that the business has covered all its bases for today’s fast-paced environment. This includes a full assessment of the multi and hybrid cloud environment’s scalability, availability, and key resource metrics for running workloads - along with the associated fees and vendor contracts.
A business’ data strategy should work towards optimising cloud workloads but also be cost-flexible enough to encourage innovation. This keeps the business agile now and adaptable to evolving future organisational needs. By using a well-planned, well-executed enterprise data strategy to drive a company’s cloud strategy, enterprises can leverage the cloud to drive business success.
