The game-changing potential of generative AI (gen AI) is the talk of the boardroom. However, turning AI explorations into production-level services is proving challenging.

Recent research from Deloitte found that over two-thirds of executives believe fewer than one-third of their gen AI experiments will be fully scaled in the next three to six months.

The consultant said that while enterprises have seen “encouraging returns” on their initial AI investments, they often find that creating value with gen AI and deploying it at scale is hard work.

That sentiment resonated with Madoc Batters, head of cloud and IT security at Warner Leisure Hotels, when asked by ZDNET to contemplate the state of AI and the hype surrounding emerging technology.

“There’s a lot of talk about gen AI, and a lot of people saying they’re going to put the technology into certain areas of their business, but there aren’t many people doing it,” he said.

Batters has a long-standing interest in exploring AI and machine learning. Rather than sitting on the sidelines and waiting for other digital leaders to progress in AI, he’s helping Warner put emerging technology into production. Here are his four best-practice lessons.

Batters said digital and business leaders often feel under pressure to exploit AI as quickly as possible — and that’s a mistake.

“Many people focus on gen AI because it’s that burning sun in the sky,” he said. “They feel like they have to do work in this area. And I think, sometimes, you need to get all the other bits of the foundations in place first.”

Batters said essential underlying elements, including data, cloud, and networks, support Warner’s AI transformation efforts. Warner has a cloud-first strategy and uses technology specialist Alkira’s network infrastructure-as-a-service approach.

Batters said a willingness to test is crucial for business leaders who want to push gen AI services into production.

“You need to experiment, make sure it works or doesn’t work, and be able to change things quickly,” he said, suggesting the importance of the oft-repeated mantra in IT development of “fail fast”.

“Having a pipeline that allows you to effect change is key. Then you’re ready to start experimenting with gen AI. See what works and what doesn’t. If it fails, you can fall back.”

While many companies struggle to turn AI explorations into production systems, research from consultant McKinsey suggests IT is the business function that has seen the largest increase in AI use during the past six months, with the share of respondents using AI increasing from 27% to 36%.

Deploying gen AI into production often involves a new way of working. So, what do Warner’s IT and line-of-business professionals think of the technology?

Batters said they’re impressed, and that’s due to the company’s careful approach to implementation.

“We don’t enforce anything,” he said. “We can put guardrails on to stop people deploying things if we think it’s too much. But we believe in giving developers the autonomy of choice and being able to decide if it’s a good or bad thing.”

Batters said a challenge his business has found, and one that’s likely to be common across all enterprises, is ensuring data is ready for AI-led initiatives.

Once that hurdle is cleared, it’s easier to consider using gen AI across other use cases.

“This technology is cheap, especially when using it within your cloud deployment, rather than going externally to the third-party companies,” he said.

“You must embrace gen AI. If you don’t use it, your business could be left behind. However, you have to use gen AI responsibly, so that you’re not exposing any of your company’s data.”

Batters said the choice of models is crucial. Business leaders must ensure they know what’s happening with their data and how it’s used by a model, including for training purposes.

“Success isn’t all about the model’s size. It’s about how good your prompting and workflows are. You may ask your model a question and say, ‘Hey, based on the output you’ve just given me, I’m going to ask another question.’ So, it’s asking multiple levels of questions within your prompting and establishing a workflow for the query.”

Explore IT Tech News for the latest advancements in Information Technology & insightful updates from industry experts! 

Source: https://www.zdnet.com/article/4-ways-to-scale-generative-ai-experiments-into-production-services/