Summary
” he said. “If they can wait 30 seconds, you can go with cheaper hardware. If they need it immediately, you’re probably going to be on more cutting-ed…
What this means for you
AMD and Cloudera are collaborating to help enterprises optimize AI infrastructure costs by matching hardware choices to specific performance needs. For Chinese readers in the US, this means that decisions about AI hardware could affect future job opportunities in tech sectors, the cost of cloud services used by businesses, and the feasibility of AI projects for student researchers or new immigrants starting ventures. The discussion highlights that there is no one-size-fits-all solution yet, and that factors like network egress fees must be carefully calculated, which could impact the total cost of running AI applications. Readers working in AI, data science, or IT infrastructure may see shifts in how their companies approach hardware procurement and budgeting.
Right-sizing infrastructure starts with understanding what a business needs its technology to accomplish.
For enterprises moving AI into production, cost pressures are sharpening the need to connect technical performance with business value. Performance figures alone don’t tell customers what an investment will mean for their business, according to Jeremy Girven, AWS technical enablement manager at Advanced Micro Devices Inc.
“Is it acceptable for a customer, your end user, to wait 30 seconds for a response, or do they need it immediately?” he said. “If they can wait 30 seconds, you can go with cheaper hardware. If they need it immediately, you’re probably going to be on more cutting-edge hardware.”
Girven spoke with theCUBE host Rebecca Knight at EVOLVE26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed infrastructure right-sizing, AMD’s collaboration with Cloudera and the economics of enterprise AI deployment. (* Disclosure below.)
Right-sizing infrastructure requires ongoing attention
AMD and Cloudera’s collaboration includes ongoing validation of AMD products for Cloudera deployments. Customers’ budget concerns are a central part of those infrastructure discussions, Girven explained.
“I would say if you don’t have the skill sets, you pull in a partner like Cloudera [or] partner with AMD, and we can help design the solution to meet the needs,” he said. “We’re not to the point where we have cookie-cutter solutions with AI yet … right now, it’s kind of very bespoke for each customer.”
Right-sizing infrastructure remains important after deployment. Enterprises should monitor utilization and adjust capacity repeatedly, while considering where their workloads run, Girven explained.
“I would say definitely don’t just focus on the technology of AI itself, but also keep in mind there’s network fees and things like that that stack on top of it,” he said. “I’ve seen many customers get bit by network egress fees that they didn’t even calculate for.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of EVOLVE26:
(* Disclosure: TheCUBE is a paid media partner for EVOLVE26. Neither Cloudera, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
Source: SiliconANGLE
Join the discussion
Have you or your company had to make trade-offs between hardware cost and performance when deploying AI projects, and how did you handle the decision?
