
{"id":4317,"date":"2026-05-07T21:20:32","date_gmt":"2026-05-07T21:20:32","guid":{"rendered":"https:\/\/rax-stg-wp-aws.com\/blogs\/what-it-takes-to-run-enterprise-ai-in-production-and-why-we-are-collaborating-with-amd\/"},"modified":"2026-11-03T19:26:32","modified_gmt":"2026-11-03T19:26:32","slug":"what-it-takes-to-run-enterprise-ai-in-production-and-why-we-are-collaborating-with-amd","status":"publish","type":"blogs","link":"https:\/\/www.rackspace.com\/de\/blogs\/what-it-takes-to-run-enterprise-ai-in-production-and-why-we-are-collaborating-with-amd\/","title":{"rendered":"What It Takes to Run Enterprise AI in Production and Why We Are Collaborating with AMD"},"content":{"rendered":"<p>The conversations we are having with CIOs, CTOs and chief data officers are changing. In regulated industries across healthcare, financial services and the public sector, the focus is shifting from how to build AI to where it should run and who is accountable once it is in production. That shift is what led us to a Memorandum of Understanding with AMD today.&nbsp;<\/p>\n<p>Access to models and&nbsp;compute&nbsp;has improved quickly, allowing teams to stand&nbsp;up&nbsp;new use cases with little friction. Once those systems move into production, the requirements change. Risk tolerance drops, oversight&nbsp;increases&nbsp;and the environment, where it runs and who is accountable, becomes just as important as the model itself.&nbsp;<\/p>\n<p>Enterprise AI adoption often slows at exactly this point. The technology is capable, but the challenge is running it in environments where governance, uptime, data&nbsp;residency&nbsp;and accountability are&nbsp;required&nbsp;from the start.&nbsp;<\/p>\n<p>Accelerated&nbsp;compute&nbsp;infrastructure is now a critical decision in enterprise architecture. What has changed is how directly it shapes where AI workloads can run, how they are governed, how they&nbsp;scale&nbsp;and what they cost to&nbsp;operate&nbsp;over time.&nbsp;<\/p>\n<p>With this MOU, we are working to integrate AMD&nbsp;Instinct\u2122&nbsp;GPUs, AMD EPYC\u2122&nbsp;CPUs and the&nbsp;ROCm\u2122&nbsp;software ecosystem directly into the governed AI infrastructure&nbsp;Rackspace Technology&nbsp;operates, so those decisions can be made deliberately and executed in production.&nbsp;<\/p>\n<h3>In regulated environments, the infrastructure requirements are non-negotiable&nbsp;<\/h3>\n<p>Data cannot move freely across&nbsp;jurisdictions. Decisions require auditability. Systems must be resilient,&nbsp;observable&nbsp;and aligned to policies that exist outside the application. What works in a development or test environment does not hold up under these conditions.&nbsp;<\/p>\n<p>The decision is moving from model selection to workload placement,&nbsp;governance&nbsp;and operational&nbsp;accountability. In healthcare, financial&nbsp;services&nbsp;and the public sector, that responsibility increasingly sits with an operator. One of the largest Epic environments anywhere runs on Rackspace private cloud, not on a&nbsp;hyperscaler. That is the kind of regulated, mission-critical workload our governed AI infrastructure is built to&nbsp;operate.&nbsp;<\/p>\n<h3>Operating the full stack&nbsp;<\/h3>\n<p>Over the past two years, we have assembled a governed AI stack that reflects how enterprise AI runs across private, hybrid and sovereign environments, with governance built in from the start. This spans the control plane, the data and AI operations&nbsp;layer&nbsp;and the operating model&nbsp;required&nbsp;to run it, from infrastructure through to agents and applications.&nbsp;<\/p>\n<p>VMware Cloud Foundation 9 is the control plane that unifies&nbsp;compute, storage,&nbsp;networking&nbsp;and security across private, public, edge&nbsp;and sovereign environments. Palantir supports governed data and AI operations.&nbsp;Uniphore&nbsp;enables agent-based workflows. Rackspace&nbsp;will&nbsp;operate&nbsp;across these layers as a single system, with&nbsp;operational responsibility&nbsp;for&nbsp;performance.&nbsp;<\/p>\n<h3>AMD&nbsp;is our&nbsp;anchor partner for accelerated compute&nbsp;<\/h3>\n<p>We are not a hardware vendor building toward managed services. We are&nbsp;a governed operator. What makes AMD the right anchor for that model is not a single&nbsp;component. It is&nbsp;the architecture.&nbsp;<\/p>\n<p>AMD brings both&nbsp;Instinct\u2122&nbsp;GPUs and EPYC\u2122&nbsp;CPUs inside a single integrated&nbsp;compute&nbsp;architecture, with&nbsp;ROCm\u2122&nbsp;tooling that orchestrates workloads across both. That matters&nbsp;because&nbsp;production&nbsp;enterprise inference is heterogeneous. Frontier models run on GPU. Small language models, classical ML, embeddings,&nbsp;retrieval&nbsp;and many domain-specific workloads run more efficiently on CPU.&nbsp;&nbsp;<\/p>\n<p>Customers should not be forced to put every workload on the most expensive silicon. Our governed operating model routes each workload to the right&nbsp;compute, which is what production economics&nbsp;actually requires.&nbsp;<\/p>\n<p>That operating flexibility is critical in sovereign AI deployments, where data residency and jurisdictional requirements dictate where and how systems&nbsp;operate. It also shapes&nbsp;total&nbsp;cost of ownership, as enterprises make deliberate decisions about workload placement,&nbsp;performance&nbsp;and long-term infrastructure efficiency.&nbsp;<\/p>\n<p>The market today is dominated by commodity GPU rental, where capacity is sold by the&nbsp;hour&nbsp;and the customer carries the burden of integration,&nbsp;security&nbsp;and accountability. We are building the opposite. Dedicated accelerated compute embedded inside a governed operating model where Rackspace owns the stack from silicon to outcomes.&nbsp;Once in&nbsp;place, the full stack, from&nbsp;compute&nbsp;through inference and agents, is&nbsp;designed&nbsp;to&nbsp;operate&nbsp;under a single model of accountability.&nbsp;<\/p>\n<p>For enterprise buyers, the decision is shifting from&nbsp;purchasing&nbsp;hardware with services attached to selecting an operator that can run AI reliably in production, with accountability for governance, resilience,&nbsp;performance&nbsp;and long-term outcomes built into the model from the start.&nbsp;We aim to deliver&nbsp;an ongoing operating relationship where responsibility continues well beyond deployment as systems scale, workloads&nbsp;evolve&nbsp;and enterprise requirements change over time.&nbsp;<\/p>\n<h3>Forward-deployed engineers keep AI accountable in production&nbsp;<\/h3>\n<p>Forward-deployed engineers are central to how AI systems&nbsp;are operated&nbsp;in production. They run systems inside the customer environment and stay with them as those systems scale, taking responsibility for runtime performance,&nbsp;availability&nbsp;and stability under real-world&nbsp;conditions.&nbsp;<\/p>\n<p>Accountability stays live after deployment because the engineering team does not step away. Responsibility extends beyond delivery into how the system performs day to day, particularly in environments where uptime,&nbsp;governance&nbsp;and data residency are non-negotiable.&nbsp;<\/p>\n<p>Forward-deployed engineers extend responsibility into production and keep it there, which is how enterprise AI systems&nbsp;remain&nbsp;reliable when they are treated as infrastructure rather than short-lived projects.&nbsp;<\/p>\n<h3>Rackspace capabilities aligned to how enterprises buy and use AI&nbsp;<\/h3>\n<p>The AMD&nbsp;collaboration&nbsp;is intended to position Rackspace to&nbsp;advance&nbsp;its curated enterprise AI stack and introduce four integrated capabilities.&nbsp;Together, these capabilities span&nbsp;bare metal compute,&nbsp;developer-ready inference tooling, a fully operated inference runtime with defined SLAs, and a governed Enterprise AI Cloud. This gives enterprises a single operator accountable for every layer, aligned to the sovereignty,&nbsp;performance&nbsp;and compliance requirements of their workload.&nbsp;<\/p>\n<p>The four integrated capabilities include:&nbsp;<\/p>\n<p>Enterprise AI Cloud&nbsp;provides a fully managed private and hybrid AI environment, launching with&nbsp;AMD&nbsp;Instinct\u2122&nbsp;accelerators and the Rackspace&nbsp;operating model, with one operator accountable across the stack from&nbsp;accelerated&nbsp;compute&nbsp;to AI inference&nbsp;and agents in production.&nbsp;<\/p>\n<p>Enterprise Inference Engine&nbsp;is a fully operated, context-aware inference runtime for domain-specific enterprise AI workloads, routing each workload across CPU and GPU based cost,&nbsp;latency&nbsp;and accuracy requirements. Unlike stateless compute rental, the Enterprise Inference Engine&nbsp;retains&nbsp;domain knowledge, session&nbsp;history&nbsp;and enterprise-specific data context across queries, enabling AI agents and large language models to perform with the consistency and institutional memory that production enterprise environments require. Rackspace&nbsp;would&nbsp;own the SLA and take responsibility for availability,&nbsp;scaling&nbsp;and platform performance, with full auditability and cost accountability. This is a production-ready inference capability, not&nbsp;compute&nbsp;by the hour.&nbsp;<\/p>\n<p>Inference as a Service&nbsp;provides dedicated&nbsp;accelerated&nbsp;compute, launching with AMD&nbsp;Instinct\u2122&nbsp;GPUs and EPYC\u2122&nbsp;CPUs,&nbsp;for infrastructure and platform teams. The customer brings their own model,&nbsp;orchestration&nbsp;and engineering. Rackspace&nbsp;would&nbsp;provide reliable bare metal capacity&nbsp;across&nbsp;both CPU and GPU, matched to workload requirements,&nbsp;with operational discipline and performance SLOs.&nbsp;<\/p>\n<p>Bare Metal&nbsp;AMD Instinct&nbsp;provides dedicated, high-performance, unmanaged bare metal AMD&nbsp;Instinct\u2122&nbsp;compute for demanding training and inference workloads that require deterministic performance and direct hardware access.&nbsp;<\/p>\n<p>These capabilities reflect how enterprise AI is deployed and&nbsp;operated&nbsp;in production, with each aligned to a different buyer and level of responsibility, from infrastructure access to fully operated AI systems.&nbsp;<\/p>\n<h3>Building and operating enterprise AI in production&nbsp;<\/h3>\n<p>Together, Rackspace and AMD&nbsp;aim&nbsp;to build and&nbsp;operate&nbsp;AI systems that run reliably under real-world constraints, with clear accountability for how they perform over time.&nbsp;<\/p>\n<p>The next phase is already&nbsp;emerging. As enterprise AI evolves toward agentic workflows, where machines act on regulated data and processes run&nbsp;continuously&nbsp;without a human in the loop, the demands on governed infrastructure become even more acute. Training will&nbsp;largely sit&nbsp;with specialized providers. Inference, particularly context-aware inference on regulated data, is where production enterprise AI lives, and that is the workload&nbsp;Rackspace is&nbsp;built to&nbsp;operate.&nbsp;<\/p>\n<p>Inference itself&nbsp;is a portfolio. A frontier model serves a few critical use cases. Small language models, classical ML,&nbsp;retrieval&nbsp;and embeddings serve many more. The cost difference between routing each to the right silicon and running everything on GPU is material at production scale. The AMD&nbsp;collaboration&nbsp;will enable&nbsp;us to&nbsp;operate&nbsp;that heterogeneous stack as a single governed system.&nbsp;<\/p>\n<p>We intend to expand this capability across our broader ecosystem,&nbsp;with AMD&nbsp;as&nbsp;our&nbsp;anchor&nbsp;compute&nbsp;partner,&nbsp;demonstrating&nbsp;how governed AI systems perform in production at scale.&nbsp;&nbsp;&nbsp;<\/p>\n<p>The question is not whether organizations can build something that works, but whether they can run it reliably under real-world constraints and stand behind the outcome.&nbsp;That is the goal we are&nbsp;working toward.&nbsp;&nbsp;<\/p>\n<p>We expect to share&nbsp;that progress over the coming year, including&nbsp;planned&nbsp;live demonstrations of these systems running in real deployment scenarios at AMD Advancing AI in San Francisco this July. We hope to see you there.&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>Learn more about how we are working with AMD to run enterprise AI in production&nbsp;<a href=\"https:\/\/www.rackspace.com\/enterprise-ai\/partners\/amd\">here<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<h4>Forward Looking-Statements&nbsp;<\/h4>\n<p>This post&nbsp;contains&nbsp;forward-looking statements within the meaning of the Private Securities Litigation Reform Act of 1995.&nbsp;Actual results may differ materially from those anticipated.&nbsp;For a discussion of risks and uncertainties, see Rackspace Technology&#8217;s filings with the SEC, including its most recent reports on Form 10-K and 10-Q.&nbsp;For&nbsp;additional&nbsp;important information&nbsp;regarding&nbsp;forward-looking&nbsp;statements&nbsp;regarding&nbsp;the non-binding memorandum of understanding (MOU) with AMD, please refer to our press release issued&nbsp;on May 7, 2026, available <a href=\"https:\/\/www.rackspace.com\/newsroom\/rackspace-technology-and-amd-sign-mou-deliver-governed-ai-infrastructure-enterprises\">here<\/a>.&nbsp;The MOU&nbsp;is a framework for potential collaboration and does not constitute a binding commitment by either party to complete any specific transaction, financing or other commercial arrangement or transaction. No definitive agreements have been reached, discussions&nbsp;remain&nbsp;preliminary, and there can be no&nbsp;assurance that any such arrangements will be entered into or that the parties will reach definitive agreement on terms, or that the&nbsp;anticipated&nbsp;benefits of the collaboration will&nbsp;ultimately be&nbsp;realized. Any third-party financing&nbsp;required&nbsp;to implement the transactions contemplated by the MOU is subject to the availability of financing on acceptable terms.&nbsp;Rackspace assumes no obligation to update these statements except as required by law.&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Why enterprise AI in production demands accountability, governance and the right operating model. <\/p>\n","protected":false},"author":2,"featured_media":6343,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","format":"standard","meta":{"content-type":"","nid":"28294","content_type":"blog","created_by":"11058","authored_on":"2026-05-06T21:20:32+00:00","field_article_industries":"","tag_category":"AI Insights","field_blog_author_text":"by Gajen Kandiah, Chief Executive Officer, Rackspace Technology","seo_description":"Rackspace and AMD to collaborate to deliver governed enterprise AI infrastructure built for production, with accountability, sovereignty and operational control.","field_featured_image":"\/wp-content\/uploads\/2026\/blog_article_images\/28294-field_featured_image-Latest-Insights_0.jpg","insights_image":"\/wp-content\/uploads\/2026\/blog_article_images\/28294-insights_image-Latest-Insights.jpg","field_partners":"","rxt_platforms":"","product":"","publisheddate":"2026-05-07T21:20:32","rxt_solutions":"","opengraph_tag":"\/wp-content\/uploads\/2026\/blog_article_images\/28294-opengraph_tag-OpenGraph.jpg","x_tag":"\/wp-content\/uploads\/2026\/blog_article_images\/28294-x_tag-X-Card.jpg","teaser_flag":"Blog","seo_titile":"Enterprise AI in Production with AMD| Rackspace Technology ","field_topics":"AI","field_slug":"Running Enterprise AI in Production with AMD","footnotes":""},"categories":[178],"tags":[179,181],"class_list":["post-4317","blogs","type-blogs","status-publish","format-standard","has-post-thumbnail","hentry","category-blog","tag-ai","tag-ai-insights"],"_links":{"self":[{"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/blogs\/4317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/blogs"}],"about":[{"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/types\/blogs"}],"author":[{"embeddable":true,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/comments?post=4317"}],"version-history":[{"count":1,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/blogs\/4317\/revisions"}],"predecessor-version":[{"id":4318,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/blogs\/4317\/revisions\/4318"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/media\/6343"}],"wp:attachment":[{"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/media?parent=4317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/categories?post=4317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rackspace.com\/de\/wp-json\/wp\/v2\/tags?post=4317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}