By: Loretta Davis
If you’re starting to question whether the cloud is always the right choice, you’re not alone. For years, the cloud has been the default destination for enterprises of all sizes, so when IT leaders begin to reassess that move, it raises eyebrows.
But let’s be precise: the cloud didn’t suddenly fall out of favor. What changed is that “cloud-first” quietly became “cloud by default.” And default decisions rarely hold up under real-world pressures: budgets, latency requirements, regulatory constraints, or the growing demands of AI workloads.
But the question to ask now isn’t “cloud or on-prem?” The question is “which workloads belong where, and for how long?”
Why Cloud Feels Different Now and Why That’s Not a Crisis
1) The bill got harder to predict:
Flexera’s State of the Cloud survey estimated 27% of cloud infrastructure and platform spend was wasted. Teams have learned what cloud really costs when an app runs 24/7, moves lots of data, or carries licensing surprises. Flexera’s research shows that cost management is now central to cloud strategy, and CIOs are choosing to repatriate certain workloads.
2) Control moved from “nice to have” to non-negotiable:
The FinOps Foundation’s State of FinOps report highlights “workload optimization and waste reduction” as the top priority for practitioners because cost visibility and accountability are strategic contingencies. As the ecosystem around cloud cost governance keeps expanding, the need to control and manage expenditures and optimization solutions for workloads become more important.
3) Performance and latency stepped into the spotlight again:
CIO coverage frames the repatriation conversation around moving some workloads back on-prem when economics, performance, jurisdiction, or exit constraints make that placement a better fit. It’s not about ditching the cloud. Drivers like cost, performance, and security/privacy factor into the decision on placing workloads properly.
4) AI rewrote the requirements:
AI isn’t just another app. It’s a workload multiplier, but it can also stress processes with more expensive computing, more data gravity, increased governance pressure, and more reason to keep workloads close to their users and data. McKinsey’s cloud value research offers a valuable gut-check: only 10% of organizations in the survey said they’d fully captured cloud’s value at scale, while 40% reported no material value. This leads to the assumption that AI value depends on disciplined data and governance, far before worrying about where models run.
Busting Cloud Myths
- Myth: Cloud is always cheaper.
- Cloud is cheaper when utilization and architecture match the pricing model.
- Myth: On-prem is always safer.
- Security is an operating model, not a zip code.
- Myth: Hybrid public/private cloud is automatically messy.
- Hybrid is messy when standards and ownership are missing.
- Myth: AI is just another line item.
- AI is a new set of placement constraints.
A New Approach: Thinking Workload-First
Workload-first is a simple idea with big consequences. Organizations must decide where a workload runs based on measurable tradeoffs, not simple ideology or preconceived expectations. A practical decision uses four criteria:
• Economics: unit cost, egress and data movement, licensing, predictability
• Latency/performance: user proximity, real-time requirements, dependency chains
• Risk/compliance: residency, auditability, blast radius, backup and disaster recovery expectations
• AI demands: data proximity, governance and guardrails, workload placement
Here are some examples:
- Virtual Desktop Infrastructure (VDI)/voice: often needs low-latency patterns (edge/colocation or carefully chosen regions and a tight network design).
- ERP: depends on integration gravity, compliance needs, and change cadence (cloud can win until data movement and interfaces make it expensive).
- Data and AI inference: frequently wants proximity to data and consistent governance; many teams land on “split” architectures.
Notice what’s missing: blanket statements. Picking the right placement for your workloads is like making the right hire. Plenty of good options, but what’s the best fit for your organization?
What Workload-First Looks Like When It’s Done Right
Workload-first isn’t a one-time migration project. It’s a repeatable decision system:
- A small set of standard placement patterns (cloud, on-prem, colo, edge, split)
- Rules that don’t change by location (identity, segmentation, monitoring, backup)
- Quarterly workload reviews: does X still belong here?
This is also where the right MSP can be a game-changer: not by pushing every workload into a preferred destination, but by making mixed environments repeatable in their best home.
At Netrio, that’s the intent behind our managed services across public, private, and hybrid cloud environments. And because the hardest part of workload-first is day-2 operations (visibility, governance, and execution), NetrioNow is built to unify AI, automation, and governance to increase transparency and control across service delivery.
Coming Up…
Part 2: The Workload Placement Scorecard: A 10-question Framework You Can Use to Classify Workloads and Defend the Decision.
Part 3: Minimum-viable Hybrid: How to Run Your Workloads Without Creating A Circus.
If you want the shortcut: start with one critical workload and score it with the four lenses above. The goal isn’t to be “cloud-first” or “on-prem forever.” It’s to be right, on purpose.
