The data center market is rapidly evolving to meet growing demand for scalable, cloud-enabled workloads. Much of this growth is being driven by new technologies that both require and enable greater efficiencies, bringing new cloud services and business models within reach.
Additionally, organizations are increasingly reliant on data center services, from colocation to hyperscale, as they adapt to new challenges brought on by the COVID-19 crisis.
Major data center trends include:
- Growth in hyperscale, colocation and multi-tenancy
- Workload repatriation
- Rising cost of outages
- Higher demand for edge compute
- IT skills gap
- Sustainable or green data centers
- New storage technologies
- Expansion of automation
- Explosion of data
In general, IT infrastructure will continue to become more distributed. Enterprises will have key infrastructure in separate geographic locations in order to bring compute closer to the consumer, while a rising interest in private-cloud will drive adoption of hybrid cloud.
Gartner expects that 60% of enterprise IT infrastructures will “focus on centers of data, rather than traditional data centers,” underscoring the impact that emerging technologies will have on digital infrastructure over the next few years.
The Hyperscale Explosion
The COVID-19 pandemic forced organizations to accelerate digitalization in order to support new services, remote work and virtual, well, everything. This shift required flexibility and scalability to enable businesses to quickly pivot, roll-out and scale key services. The result was a boon for cloud providers.
The growth in hyperscale cloud computing isn’t likely to wane in coming years. At least, that is the signal from major hyperscale providers. As of 2021, there are more than twice as many hyperscale data centers as there were just a few years ago, with investments continuing to grow to meet an expected increase in demand for cloud infrastructure. This includes Microsoft’s plan to build upwards of 100 new data centers per year.
Regardless, most organizations are still relying on on-premises data centers to reduce latency and meet compliance requirements. That said, organizations are not generally expanding their data center footprints — almost all growth is from data center providers, including data center colocation, hyperscale and multi-tenancy.
Don’t Let IT Complexity Hamper Your Digital Goals
Get the latest trends and data on what’s driving transformation and how IT teams are addressing these challenges.
Workload Repatriation Is Still Common
Organizations are still figuring out what workloads should run in public-cloud versus private-cloud or on-premises infrastructure. The reasons for this are varied. Cost overruns continue to play a role especially as organizations seek to stabilize their operational expenses. Security concerns also play a role in moving workloads out of the public-cloud.
This in turn has spurred faster growth in private-cloud computing when compared to public-cloud. Research from AFCOM, included in their 2021 State Of The Data Center Report, shows that public cloud adoption grew by 4% in 2021 compared to 11% for private cloud.
Workload repatriation does seem to be slowing. The same research from AFCOM found that repatriation towards on-premises and colocation decreased from 72% to 58% in 2021. More organizations are using hybrid cloud deployments than ever before, helping to slow the pace of repatriation as organizations stabilize policies for placing workloads.
That said, data regulations and emerging technologies are complicating data centers, meaning repatriation and workload mobility will continue to be areas of focus over the coming years.
Data Center Outages Are Becoming More Expensive
Overall, data center outages are becoming less frequent. Data centers are more reliable than ever thanks to improvements in technology and processes. But that’s not to say that outages aren’t still common: the Uptime Institute found that 69% of data center operators experienced an outage over the past three years.
The Uptime Institute also reports that the average cost of outages has been growing over the last several years. Where outages resulting in losses of over $100,000 were relatively rare in 2019, today, over 60% of outages cost the business over $100,000.
A growing share of outages are also preventable. 79% of downtime could have been avoided with improved processes and policies, according to the Uptime Institute.
Moving forward, operators will need to reduce human error by eliminating manual interventions and enforcing best practices for data center management.
Data Centers Are Turning Green
While not directly related to performance goals, sustainability and environmental initiatives are a growing trend for businesses. Data centers, which traditionally have large environmental footprints because they require large volumes of power and water, are being looked at as opportunities to turn a business greener.
As consumers and regulators become more focused on environmental issues, data centers are finding ways to reduce water requirements and improve energy efficiency. Tactics for meeting green goals include new cooling technologies as well as renewable energy. Some of the largest data center operators are beginning to deploy lithium ion batteries to help mitigate the variability of renewable energy sources such as wind and solar.
Exponential Data Creates New Challenges
Data is the new oil. But unlike oil, we can create as much data as we want, or, at least, as much as we can handle.
IDC reported in 2020 that the volume of data created over the next three years will be greater than all of the data created in the previous 30 years. Much of this growth is being driven by new technologies such as the internet of things (IoT), edge computing and 5G, enabling greater data collection. The use of data-intensive tools such as artificial intelligence, machine learning and big data is also expected to grow.
However, this exponential growth in data is about to hit a wall. Specifically, a technological wall — existing data storage technologies will not be able to handle the volumes of data that are expected to be normalized by the end of the decade. Gartner predicts that, by 2025, traditional computing technologies will hit a “digital wall” that forces organizations to shift to new computing paradigms.
What do these new computing paradigms look like? New storage technologies such as glass storage and DNA storage, supported by nanotube computing, memristors or even neuromorphic computing.
In the meantime, data center operators are doing what they can to increase rack density, improving overall compute without expanding their on-premises footprint. This is made possible in part through new cooling techniques such as liquid cooling.
Automation Is Becoming Critical
Data center automation is expected to reach $19 billion by 2026, compared to only $7 billion in 2020, according to a report by Mordor Intelligence. Growth in data center automation increased in response to COVID-19 as businesses accelerated their digital initiatives. According to the Uptime Institute, 73% of data center operators have increased the use of automation as a direct result of challenges stemming from the COVID-19 crisis.
Automation is helping data center operators meet a variety of goals. By eliminating manual interventions, data center operators can reduce the risk of downtime while streamlining data processes and provisioning compute to meet real-time demand.
Additionally, data centers are finding it difficult to hire and retain experienced personnel. The IT skills gap is expected to persist for the foreseeable future as organizations compete for top talent. By automating manual tasks, organizations can accomplish more without needing to hire more full-time employees.
Automation platforms can also help ensure smooth transitions as workloads migrate to new data center infrastructure. Whether moving workloads to the cloud, repatriating or replacing racks, automation platforms can provide change management capabilities that make it easy to synchronize environments and to manage workloads across diverse infrastructure.
Preparing The Data Center For Future Challenges
Over the next few years, new technologies will drastically improve efficiency, automation and storage in data centers. This includes high-performance CPUs designed for AI, new storage technologies and more.
Organizations will need to seamlessly integrate these new technologies while ensuring workload migrations and mobility. Workload automation software will be critical to meeting these challenges, enabling IT teams to quickly integrate new systems and software for reliable workload management across a diverse, distributed ecosystem.
Ready To See How We Make Workload Automation Easy?
Schedule a demo to watch our experts run jobs that match your use cases in ActiveBatch. Get your questions answered and learn how easy it is to build and maintain your jobs in ActiveBatch.