The AI infrastructure solution expedites customers’ journey to GPT and LLMs, all the while maintaining organizational data governance.
Nutanix , a leading provider in the realm of hybrid multicloud computing, has unveiled the Nutanix GPT-in-a-Box™ solution. This offering is targeted at customers aiming to initiate their advancements in artificial intelligence (AI) and machine learning (ML) while retaining control over their data. Now accessible, the solution presents a comprehensive software-defined platform tailored for AI, accompanied by services to facilitate hardware and software setup. This platform is designed to support the deployment of a curated selection of large language models (LLMs) through prominent open source AI and MLOps frameworks on the Nutanix Cloud Platform™. The solution streamlines the acquisition of AI-ready infrastructure, enabling customers to optimize and execute generative pre-trained transformers (GPT), including LLMs, either at the edge or within their datacenter.
Numerous enterprises are confronted with the challenge of harnessing the potential of generative AI and AI/ML applications, particularly for scenarios unsuitable for the public cloud due to concerns related to data sovereignty, governance, and privacy. Every day, fresh use cases arise as organizations seek to utilize generative AI for enhancing customer service, developer efficiency, operational effectiveness, and more. From automated transcription of internal documents to swift multimedia content searches and automated analysis, organizations recognize the potential of AI but grapple with issues surrounding intellectual property security, compliance, and privacy. Moreover, businesses striving to establish an AI-ready infrastructure often confront difficulties in providing optimal support for ML administrators and data scientists, while the considerable costs associated with AI investments hinder progress in AI and ML strategies.
“Generative AI is top of mind for many enterprises, but most don’t have the in house resources to fully take advantage of this opportunity. Nutanix GPT-in-a-Box, along with solutions from DKube, simplifies enterprise AI adoption with an AI-ready stack to jumpstart innovation.” Prasad Vellanki, CEO, DKube
Greg Macatee, Senior Research Analyst in the Infrastructure Systems, Platforms and Technologies Group at IDC, remarked, “As customers look to design and deploy generative AI solutions, they find themselves struggling with balancing the deep expertise required to install, configure, and run these workloads with concerns around their data security and protecting company IP – all while controlling costs. With GPT-in-a-Box, Nutanix offers customers a turnkey, easy-to-use solution for their AI use cases, offering enterprises struggling with generative AI adoption an easier on-ramp to deployment.”
The Nutanix GPT-in-a-Box solution furnishes a ready-to-use AI infrastructure that customers can manage, either at the edge or within their central data center, empowering them to operate and fine-tune AI and GPT models while maintaining control over their data. Nutanix supplies a comprehensive array of security and data protection features that are ideally suited for safeguarding AI data.
Thomas Cornely, SVP of Product Management at Nutanix, emphasized, “Helping customers tackle the biggest challenges they face in IT is at the core of what we do, from managing increasing multicloud complexity, to data protection challenges, and now adoption of generative AI solutions while keeping control over data privacy and compliance. Nutanix GPT-in-a-Box is an opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption and help jump-start AI innovation.”The new solution encompasses:
- The industry-leading Nutanix Cloud Infrastructure™ platform, incorporating solutions like Nutanix Files Storage™ and Objects Storage™, the Nutanix AHV® hypervisor and Kubernetes, along with NVIDIA GPU acceleration, scalable from large to small scales.
- Nutanix services to assist customers in determining the appropriate cluster size and deploying a well-defined stack featuring top-tier open source deep learning and MLOps frameworks, an inference server, and a curated array of large language models such as Llama2, Falcon, and MPT.
- The ability for data scientists and ML administrators to promptly utilize these models with their chosen applications, enhanced terminal UI, or standard CLI.
- The platform is adaptable to accommodate other GPT models as well as enable the fine-tuning of these models by leveraging internal data hosted on included Nutanix Files or Objects Storage services.
Jon Cosson, CISO at JM Finn, a regulated financial services organization, expressed, “Leveraging AI to more efficiently and effectively help our customers is a top priority for us but, as a regulated financial services organization, maintaining full control over our data is necessary. The Nutanix Cloud Platform delivers the performance, flexibility and security required to safely deploy AI workloads.”
The Nutanix GPT-In-a-Box solution capitalizes on the full stack scalability, performance, resilience, and user-friendliness that characterize the Nutanix Cloud Platform. Nutanix’s proficiency in scalable infrastructure across public cloud, datacenter, and edge use cases offers an optimal environment for refining and executing AI applications while retaining data control. Notably, 78% of Nutanix customers in a recent survey expressed their likelihood to operate their AI/ML workloads on the Nutanix Cloud Platform.
Nutanix’s deep-rooted involvement in the open source AI community equips customers with a strong framework for developing their AI strategies. Notable contributions encompass participation in the MLCommons (AI standards) advisory board, co-founding and leading technical aspects of the ML Storage Benchmarks and Medicine Benchmarks, and serving as a co-chair of the Kubeflow (MLOps) Training and AutoML working groups at the Cloud Native Computing Foundation (CNCF).
In a rapidly evolving landscape where artificial intelligence and machine learning are becoming integral to innovation across industries, the Nutanix GPT-in-a-Box solution emerges as a pivotal enabler. By addressing the complex challenges associated with generative AI adoption, data privacy, and infrastructure management, Nutanix offers organizations an accessible pathway to harness the transformative potential of AI and ML technologies. With its user-friendly approach, robust security features, and alignment with open source AI advancements, this solution not only simplifies the deployment of AI models but also empowers businesses to drive innovation, enhance productivity, and safeguard their data assets. As the demand for AI solutions grows, Nutanix’s contribution to the AI ecosystem sets the stage for a future where cutting-edge technologies can be harnessed with confidence and control.
The Nutanix GPT-in-a-Box solution is now available to customers. Interested parties can access more details here.