Enable javascript in your browser for better experience. Need to know to enable it?

ºÚÁÏÃÅ

AI everywhere

Ìý

Leveraging cutting-edge breakthroughs to scale your business

Ìý

Generative AI (GenAI) has captured the spotlight, but in reality it’s just one aspect of a much broader field that is advancing on multiple fronts. One of the things GenAI has proven is that AI can be made available, accessible and applicable to more people. This democratization has prompted a rush of experimentation and investments in everything from to .ÌýÌý

Ìý

What all this will mean for organizations at the day-to-day level is less clear. We are firm believers that AI is already and will continue to have a major impact on some processes integral to being a digital business, notably software development, enabling enterprises to build and bring products to market faster.ÌýÌý

Ìý

It’s important to understand that, for all the excitement, AI won’t always be a transformational force. Heavyweight commercial large language models (LLMs) are powerful but — at least for now — generally too expensive for most organizations to use for anything at scale. The buzz surrounding ChatGPT means that it can become a ‘hammer looking for a nail,’ with companies rushing to integrate it into processes when it may not actually be necessary, or the right tool for the job.Ìý

Ìý

Organizations need to put a few fundamental building blocks in place before they can take advantage of the AI breakthroughs that seem to be emerging every day. One is a solid data strategy, as outlined in our data platform lens, that ensures a base level of relevant, credible and traceable data is readily available to feed into AI models. Without this foundation, an AI solution may simply enable the business to make misguided decisions faster.Ìý

Ìý

It's also critical to employ tools like GenAI with a basic idea of what ‘good’ looks like for the outcome you’re trying to achieve. While these tools can be directed, they can’t be trusted to work without supervision, or to vet the quality of the results. Having a handle on the direction and the output of your AI systems is part of a responsible technology practice, and essential to avoiding unintended consequences.Ìý

Ìý

Once these parameters are in place, we encourage organizations to start testing AI with possible use cases emerging in their operations. Like all innovations, it can be difficult to understand the full potential or range of applications until the technology is firmly in play.Ìý

Mike Mason, ºÚÁÏÃÅ
As AI integration becomes more sophisticated and the implications for getting things damagingly wrong multiply, the need for effective risk management grows too.
Mike Mason
Chief AI Officer, ºÚÁÏÃÅ
As AI integration becomes more sophisticated and the implications for getting things damagingly wrong multiply, the need for effective risk management grows too.
Mike Mason
Chief AI Officer, ºÚÁÏÃÅ

The opportunities

Ìý

By getting ahead of the curve on this lens, organizations can:Ìý

Ìý

  • Smooth and accelerate human-computer interactions. Advancements in natural language processing (NLP) are opening up new ways for people to communicate with machines, including through everyday conversations. This is both broadening the scope of people who can interact with these systems and making it far easier to plan and execute tasks such as summarizing information, providing self-contained answers to inquiries or context and information to support certain roles or even generating and curating content.ÌýÌý

    Ìý

  • End the terror of the ‘blank page.’ Whatever the task or project, coming up with the initial idea(s) and making a start from essentially nothing is often the toughest part. AI can eliminate blank page paralysis by conducting research and providing a list of suggestions or insights that, even if far from the desired result or finished article, can serve as a jumping-off point or prod recalcitrant minds into action.Ìý

    Ìý

  • Automate tasks — not entire jobs. The need for human involvement to guide and ultimately evaluate AI output makes the wholesale outsourcing of roles to AI systems less likely than many people think. That said, there are a multitude of tasks that AI can automate or where it can augment human input, making the work more consistent and efficient. Any task that requires access to and analysis of a vast body of knowledge — such as a large number of research papers, or databases of medical or financial information — can be seen as a promising candidate for LLM assistance. The bar for what AI can do will constantly shift, but in general, as some have advised, it can be helpful to think of AI ‘’ – that is, the equivalent of a competent research assistant or army of well-intentioned interns. There are some duties AI can be trusted with – but it certainly can’t be trusted with everything.Ìý

    Ìý

  • Revolutionize software delivery. There’s a misconception that in building software, GenAI’s main use is as a tool to ease coding, when in reality it can touch on all aspects of the development lifecycle. Potential applications beyond coding assistance include brainstorming with AI to improve our requirements and testing scenarios; improved incident response and debugging by translating natural language into queries over logs and metrics; product and strategy ideation; and searching unstructured institutional information to provide valuable context to developers. Based on our experiences, we believe AI-assisted software delivery has the potential to drive productivity increases of up to 30%.Ìý

Human speaking into a mobile phone
Human speaking into a mobile phone

What we've done

Enhancing conversational AI with language models with Jugalbandi

Ìý

We worked on a chatbot that helps users navigate the complexity of the Indian government’s various welfare schemes. It’s a testament to AI’s ability to not only navigate, process and summarize vast amounts of information in an easily digestible format, but also to meet a much more inclusive user base on its own terms. We combined a number of existing LLMs and translation models to power conversational AI via voice, both incoming and outgoing, in multiple local languages and dialects. This provides an access point and source of information on government services to a rural user base with high illiteracy rates. This has vastly extended and simplified interactions between the Indian government and many of its citizens in remote and non-urban areas.Ìý

Ìý

Actionable advice

Ìý

Things to do (Adopt)

Ìý

  • Identify AI champions who can help guide and teach your organization about the potential use cases for emerging solutions — but understand that AI can and will be applied in different ways in almost every part of the enterprise, which means these champions need to keep an open mind. Having people with a clear idea of what ‘good’ looks like can reduce risks and ensure AI initiatives focus on meaningful business results.

    Ìý

  • Especially in the short term, focus on how humans and AI work together. Ensure teams understand how AI can augment, not threaten, the tasks that are core to their roles, and where their judgment will need to take over. Watch and manage the costs of services people use, which are generally not visible to an individual user but can add up quickly. Depending on the task, it can be worth sacrificing a degree of accuracy for lower costs, as models that are only slightly less accurate may be substantially cheaper to run.Ìý

    Ìý

  • Identify clear AI use cases that drive real value for your organization, as well as areas where you explicitly will not use AI, either because it makes no business sense, the costs outweigh the necessary investments or the associated risks are simply too high. As the list of potential applications is massive and constantly expanding, having these decisions to orient around will ensure your AI efforts are carefully targeted and therefore more likely to bear fruit.Ìý

    Ìý

  • Be deliberate about which technology you’re using. ‘AI’ has become at times a catchall for a range of distinct technologies and, more recently, used to refer to GenAI alone. The capabilities and use cases for GenAI versus other technologies that are at times lumped under the AI umbrella — like machine learning — can be very different, and clarity is needed on what you’re planning to implement and how it connects to the problems you’re trying to solve.Ìý

    Ìý

  • Define and communicate ‘guardrails’ early on. Well before they’re interacting with AI on an everyday basis, teams should be aware of standards and expectations in terms of security, data sources and vetting systems or their outputs for transparency and/or bias. They should also be aware of when to give up on experiments when they are unlikely to yield the desired outcome or result in excessive risks.ÌýÌý

Ìý

Ìý

Things to consider (Analyze)

Ìý

  • Open-source alternatives to commercial LLMs, which are improving and more of which are emerging every day. like FastChat-T5 can provide a solid base for chatbot and customer support applications, and be developed into specialized models that protect the organization’s intellectual property.Ìý

    Ìý

  • AI Agents. Recent programming interfaces by companies such as OpenAI offer the ability to combine the functionality of publicly available generative AI models with specific knowledge from outside the model, such as product information.

    Ìý

  • New vendor offerings. Public cloud vendors such as and announced a wave of new products and services for people who are creating software towards the end of 2023. In many cases these tools offer compelling features, such as AI-assisted deployment and operation of the software being created. Encourage your AI champions to regularly evaluate a variety of offerings.

Ìý

Ìý

Things to watch for (Anticipate)

Ìý

  • Waves of regulation. As demonstrated by the over an AI act in the European Union, governments are scrambling to legislate against some of AI’s more negative perceived impacts and new rules about all facets of AI are likely to be coming fast from all directions. Organizations need to be proactive about establishing policies to ‘do the right thing’ before they are forced to, so compliance becomes a matter of course.

Read Looking Glass 2024 in full