Ensuring data centre efficiency in an AI-driven world

By Alan Stewart-Brown, VP EMEA, Opengear.

Governments around the world are increasingly investing in artificial intelligence (AI), with the UK taking a leading role. In the 2023 Autumn Statement, it was announced an additional £500 million for AI computing over the next two fiscal years as part of an expansion of the AI Research Resource.

 

With increased investment comes far-reaching implications for data centre infrastructure. As AI technologies grow more sophisticated and their applications more widespread, data centres face growing pressures to evolve at speed while ensuring security, sustainability, and scalability.

 

In this context, scalability is no longer a luxury but a necessity. As AI solutions grow, the demand for processing power escalates, forcing data centres to expand their capacity quickly and efficiently. However, this expansion is not simply about adding more servers or storage. Effectively managing the increased load also requires advanced orchestration, automation, and network management.

 

Sustainability, security, and service continuity

 

As with any consideration in the world of data centers, the environmental impact is a key factor. More power means increased energy consumption and a larger carbon footprint, therefore data centres are compelled to not only manage their energy consumption more efficiently but also to invest in renewable energy sources and advanced cooling technologies. Ensuring the longevity of sustainable data centres amid rapid AI expansion requires a balanced approach to growth and environmental responsibility.

 

As data centres become more integral to AI operations, the stakes for network security and operational continuity are raised even further. The complexity of AI applications and the data they process require robust protection against cyber-threats and efficient recovery systems to manage potential disruptions.

 

Further ramping up the challenge, data centre businesses are faced with having to do all of this with what is, in many cases, a shrinking workforce. The Uptime Institute Data Center Staffing Survey 2023 revealed that 58% of data centre operators reported that their organisation is having difficulty finding qualified candidates for open jobs.

 

More specifically, there is also a shortage of network engineers in many regions, with research by Opengear revealing that more than six out of ten (61%) UK CIOs expect at least 25% of their network engineers to retire in the next five years.

 

So, with the ongoing advance of AI continuing to place their networks under increasing amounts of pressure, many data centres have been forced to face up to a wide range of other challenges – from intensifying cyber-threats to growing skills shortages – that make managing these pressures effectively even more difficult.

 

That’s where AI-driven network management solutions fit in, ensuring that data centres can expand in size and capability, even with network engineers in short supply, without impacting efficiency or performance. Alongside this core network management capability, power management and monitoring can be leveraged, helping data centres to achieve greener operations. At the same time, so as to ensure they can maintain service continuity even under adverse conditions, data centres need to be looking at solutions like Smart Out of Band Management that provide an independent overlay management network and ensure seamless connectivity for both Ethernet and serial management. In this way, they can help ensure they are achieving robust network management, whatever their evolving needs may be.

 

To do all this effectively, however, involves data centres upgrading their physical infrastructure and integrating AI within their operational frameworks to optimise processes and pre-emptively address potential issues.

 

President Biden's recent executive order in the US highlights the focus on AI's implications for business operations, positing a future where data centres are central to AI-driven innovation. This governmental spotlight highlights the need for data centres to continue focusing on early adoption of new technology that puts them in a good position to manage the increasing demands of AI workloads.

 

Ensuring resilience and efficiency

 

The rapid growth of AI technology places immense demands on data centres, necessitating a multifaceted strategy to achieve scalability, sustainability, and security. Government investments in AI, particularly in the UK and US, emphasise the critical role of data centres in this evolving landscape. To meet these challenges, data centres must swiftly upgrade their infrastructure, incorporating advanced AI-driven technologies for network management and automation. These enhancements are essential not only for handling increasing computational loads but also for ensuring energy efficiency and robust cybersecurity.

 

Additionally, addressing workforce shortages through innovative solutions is crucial for maintaining operational continuity both now, and in the decades ahead. By adopting cutting-edge technologies and strategic workforce management, data centres can remain resilient and efficient. This proactive approach will enable them to support the ongoing expansion and complexity of AI applications, ensuring they continue to meet the demand in a responsible way.

 

By Krishna Sai, Senior VP of Technology and Engineering.
By Danny Lopez, CEO of Glasswall.
By Oz Olivo, VP, Product Management at Inrupt.
By Jason Beckett, Head of Technical Sales, Hitachi Vantara.
By Thomas Kiessling, CTO Siemens Smart Infrastructure & Gerhard Kress, SVP Xcelerator Portfolio...
By Dael Williamson, Chief Technology Officer EMEA at Databricks.
By Ramzi Charif, VP Technical Operations, EMEA, VIRTUS Data Centres.