Enterprise-ready GenAI application delivery
Intelligent app delivery with VMware Tanzu AI Solutions
Tanzu AI Solutions applies enterprise standards to GenAI app delivery and management, so you can accelerate intelligent app delivery.
Faster GenAI app delivery
With Spring AI in Tanzu Platform, Java devs transform into GenAI app devs with familiar tools and AI accelerators.
Safer GenAI app operations
With GenAI on Tanzu Platform, control access to approved models and automate complex AI patterns for safer intelligent app delivery.
More accurate GenAI models
With observability in Tanzu Platform, you can evaluate and improve model performance and accuracy.
Scale intelligent app delivery with consumable dev frameworks, governance and monitoring
Tanzu AI is a set of capabilities within Tanzu Platform that enables customers to develop, operate and optimize AI-powered applications more safely and at scale. When incorporating GenAI into applications, organizations deploying and running these apps in production will meet several challenges, including complex multi-model management, increased iteration pace, model cost management requirements, and new operations requirements like model evaluation, scalability and governance. Tanzu AI Solutions addresses these challenges by providing a unified Java-native platform covering the full spectrum of the AI application development lifecycle. With Tanzu AI, you can:
Improve safety
Tanzu AI improves the safety of intelligent applications through built-in application and model monitoring for hallucination and relevance as well as an AI middleware layer that introduces governance, auditing and compliance features.
Bridge skill gaps
Use your current team without having to incur cost or time to reskill. Java developers can use familiar frameworks and a friendly path to production rather than having to reskill on new tools.
Increase speed to market
Tanzu AI helps organizations rapidly bring intelligent apps to market by improving developer productivity through consumable AI app frameworks and access to approved models that have been curated by your platform engineering team.
Streamline operations
Tanzu AI includes observability and the ability to tune model accuracy and performance, while controlling the cost of LLMs and GenAI apps at runtime.
Use Cases
AI-powered productivity
Using natural language processing, virtual assistants and applications can increase productivity and efficiency across large enterprises and companies. This can bring a new level of intelligence to today’s work environment by continuously adapting and learning to meet enterprise needs.
AI-powered customer support
GenAI can help enterprises get their customers and employees to resolution faster. By leveraging the efficiency and support of GenAI chatbots, you can streamline processes and enhance user experience, ultimately ensuring swift and effective outcomes for users.
AI-powered pattern detection
Leverage GenAI to quickly identify patterns and address them. For example, you can identify instances of fraud, delinquencies or other banking anomalies to identify and flag for intervention, keeping systems more reliable and secure.
Private AI for regulated industries
Tanzu AI Solutions offers private model serving in several constructs which can increase data residency and processing so that you can deliver AI-powered intelligent applications while remaining compliant.
GenAI App Dev Services
For over 30 years, Tanzu Labs has been helping organizations bring innovative products to market. We take an evidence-driven approach to AI product development, integrating a forward-looking design practice with deep experience building high risk systems in regulated environments like finance, healthcare and government. Tanzu Labs can help your organization take use cases from idea to production, overcoming barriers in safety, accuracy and cost management with small, fast, low risk experiments.
Learn about Tanzu LabsFrequently Asked Questions
What is GenAI?
Generative artificial intelligence (generative AI, GAI or GenAI) is artificial intelligence that generates text, images or data by utilizing generative models in response to prompts. Generative AI models learn the patterns and structure of their input training data and generate new data with similar characteristics.
What is Spring AI?
Spring AI is an open source application framework that can be used by Java developers to build AI-capable applications. The Spring AI project aims to streamline the development of applications incorporating artificial intelligence functionality, eliminating unnecessary complexity. Read the docs
How can Spring AI benefit developers?
Spring AI bridges the AI skills gap for building new and retrofitting existing applications, so developers can deliver AI-capable apps more quickly and easily. With Spring AI, Java developers can seamlessly integrate AI capabilities without needing to cross-train in Python.
Which features are included in Spring AI?
Spring AI offers developer-friendly Java APIs that can be used to access LLM models and implement higher level AI patterns and application logic patterns:
- Spring AI enables easy access to the most popular AI models, empowering developers to create robust AI-capable apps swiftly.
- Spring AI offers exceptional portability, simplifying the process of switching between different AI models.
- Spring AI is fully integrated into the Spring ecosystem, allowing developers to leverage the extensive Spring ecosystem to build apps quickly.
- Spring AI is compatible with and can be run within Tanzu Platform.
- Spring AI offers portable API support across various AI providers for chat, text-to-image and embedding models. It supports both synchronous and stream API options. Additionally, it allows you to access model-specific features with ease.
- The Spring AI feature set empowers you to execute typical scenarios like "Q&A over your documentation" or "Chat with your documentation."
What is GenAI on Tanzu Platform?
GenAI on Tanzu Platform offers private GenAI services within a Tanzu Platform environment. Developers can run a private GenAI-style application inside Tanzu Platform.
How can GenAI on Tanzu Platform benefit developers?
Developers can build, run and manage GenAI applications within Tanzu Platform while using their existing tooling.
Which features are included in GenAI on Tanzu Platform?
- Private access to these LLM tiles using your existing Tanzu Platform network space inside your data centers or virtual private clouds
- Being able to use the `cf push` interface to build and run private AI-based applications
- Tanzu Platform marketplace offerings that allow for direct service bindings to LLMs
- Support for AWS, GCP and vSphere IaaSes
- The ability to deploy a curated GenAI tech stack on your existing Tanzu Platform Foundation(s)
- An extended Tanzu Platform ecosystem with GPU-enabled virtual machines
- Large Language Model service plans through the Tanzu Platform marketplace
- Completely private and secure next-generation LLMs and GenAI technology
How is this different from public GenAI capabilities?
Unlike public GenAI, our private offering provides private access to your LLM tiles using your existing Tanzu Platform network space inside your data centers or virtual private clouds without any token or rate limitations.
Which Tanzu Data Solutions are compatible with Tanzu AI Solutions in Tanzu Platform?
- Tanzu GemFire is a high-performance in-memory data grid that lets you create strong vector databases, making it well-suited to work with the tremendous data volumes and responsiveness required by GenAI.
- Tanzu Greenplum is an advanced data platform that combines the benefits of massively parallel processing (MPP) architecture along with integration with popular data science tools and libraries, making it suitable for developing and deploying AI solutions.
- Tanzu RabbitMQ supports multiple messaging protocols (e.g. AMQP, MQTT) and excels in enabling messaging and streaming for AI-powered applications.