COMPANY NEWS: Enables organisations to embrace AI with confidence by providing unparalleled insights into all layers of AI-powered applications, helping ensure security, reliability, performance, and cost-effectiveness
Dynatrace (NYSE: DT), the leader in unified observability and security, today announced it has extended its analytics and automation platform to provide holistic observability and security for large language models (LLMs) and generative AI-powered applications. This enhancement to the Dynatrace platform enables organisations worldwide to embrace generative AI confidently and cost-effectively as part of their focus on increasing innovation, productivity, and revenue.
Dynatrace AI Observability is a comprehensive solution. It covers the end-to-end AI stack, including infrastructure, such as Nvidia GPUs, foundational models, such as GPT4, semantic caches and vector databases, such as Weaviate, and orchestration frameworks, such as LangChain. It also supports the major platforms for building, training, and delivering AI models, including Microsoft Azure OpenAI Service, Amazon SageMaker, and Google AI Platform.
Dynatrace AI Observability leverages the platform’s Davis AI and other core technologies to deliver a precise and complete view of AI-powered applications. As a result, organisations can provide great user experiences while identifying performance bottlenecks and root causes automatically. Dynatrace AI Observability with Davis AI also helps them comply with privacy and security regulations and governance standards by tracing the origins of the output created by their apps with precision. Additionally, it helps them forecast and control costs by monitoring their consumption of tokens, which are the basic units that generative AI models use to process queries.
“Generative and predictive AI will unlock new possibilities for our business with our ML and LLM services, but to implement them successfully, we need to ensure that our services supporting these critical workloads are reliable and perform well,” said Ryan Berry, SVP Engineering & Architecture at OneStream. “That’s why we rely on Dynatrace, a leader in AI and observability. Our teams use Dynatrace to build and optimise generative AI apps that perform well and are cost effective to manage and deploy at scale.”
Gartner states, “By 2028, the adoption of AI will culminate in over 50% of cloud compute resources devoted to AI workloads, up from less than 10% in 2023. ”This growth partially reflects organisations’ surging interest in generative AI to improve efficiency and productivity, drive automation, and foster innovation. Despite this momentum, many organisations are concerned about costs associated with generative AI-powered services. These can be many times more expensive than traditional cloud services and are difficult to forecast because they are based on the consumption of generative AI tokens by applications that are not yet in production. Simultaneously, governments worldwide are establishing regulations focused on the use of AI technologies in a responsible and ethical manner and in compliance with applicable laws.
Organisations cannot afford to ignore the potential of generative AI. However, they need comprehensive AI observability to help their generative AI investments succeed and avoid the risk of unpredictable behaviours, AI “hallucinations,” and bad user experiences.
“Generative AI is the new frontier of digital transformation,” said Bernd Greifeneder, CTO at Dynatrace. “This technology enables organisations to create innovative solutions that boost productivity, profitability, and competitiveness. While transformational, it also poses new challenges for security, transparency, reliability, experience, and cost management. Organisations need AI observability that covers every aspect of their generative AI solutions to overcome these challenges. Dynatrace is extending its observability and AI leadership to meet this need, helping customers to embrace AI confidently and securely with unparalleled insights into their generative AI-driven applications.”
“AI-powered transformation is a key driver of productivity and competitiveness for organisations worldwide,” said Ali Dalloul, VP, AI, Microsoft. “Microsoft Azure OpenAI Service is a robust generative AI solution for enterprises and public sector entities across the globe. We’re pleased to partner with Dynatrace, a leader in AI-powered observability, to empower our shared customers, the teams driving innovation in the world’s largest organizations, to create generative AI-based services using Azure Open AI Service and Dynatrace AI Observability. This powerful combination helps ensure these services achieve the highest security, reliability, and performance standards while enabling the teams that manage them to control costs.”
Dynatrace AI Observability is available starting today for all Dynatrace customers. Visit the Dynatrace website for the current list of technologies and integrations supported by Dynatrace AI Observability. Visit the Dynatrace AI Observability blog for additional details about the solution.
