← Experience

AI platform / adoption and governance

Make AI useful, governable and operable.

I helped design, build and launch an enterprise LLM Gateway at Cloudera: a supported route through which people, developer tools and applications can use models sourced from AWS, Azure and GCP.

The gateway is the visible part of a wider operating model. My work connects the platform architecture with identity and access, data protection, model governance, cost attribution, operational support and the decisions the business needs to make as AI changes.

1,500
users supported
120
teams using the service
>150bn
tokens processed each week
Jan 2026
production launch

The 30-second view

Enterprise AI needs more than access to a model.

People need a capable route that helps them get useful work done. Security and governance teams need to understand how information is handled. Finance needs to know where the money is going. Platform teams need something they can support, improve and operate reliably. Leadership needs a way to make decisions while the technology and supplier landscape continue to move.

I work across those needs. The result is an enterprise service that makes approved AI easier to adopt and easier to operate.

01

The LLM Gateway

The gateway creates one consistent access layer across models sourced from AWS, Azure and GCP. People and applications use a supported interface, while the organisation can apply identity, access, data, cost and operational controls in one place.

It provides a controlled internal environment in which people can experiment and work safely. Keeping internal inference on that governed route gives users freedom to explore while preserving the protections and operational visibility the organisation needs.

I led the programme across the decisions needed to move it from an idea into production: the platform approach, provider integration, security review, access model, team and budget structure, FinOps attribution, onboarding and the work required to make it an ongoing service.

That involved working across Cloud Operations, engineering, security, finance, governance and provider teams. No one of those groups had the complete answer alone. The platform needed their concerns to meet in one design.

The service provides

One route, with the controls and support around it.

01

Multi-provider access

A consistent route to approved models across multiple providers.

02

Identity and access

Access tied to people, teams and legitimate business use.

03

Replaceable routes

Model and provider choices can change without every client being rebuilt.

04

Data protection

Data-handling controls and a clear route for security review.

05

Economic visibility

Detailed token usage, budgets and full cost allocation.

06

Operational evidence

Logging, monitoring and the information needed to support the service.

07

Supported adoption

Onboarding for web, command-line, development and application use.

08

A foundation to extend

A governed base for new capabilities such as tools and agents.

02

Build an operating service, not a launch project

Production launch is the beginning of a platform's life.

Models change, providers introduce new capabilities, client tools behave differently and costs move as people find new ways to use the service. A useful AI platform needs normal operational ownership: monitoring, support, incident handling, upgrades, model onboarding and retirement, documentation and clear routes for change.

The runbooks around the gateway are evidence of that work. They cover practical issues such as provider differences, model compatibility, caching, excessive tool context, guardrail stability, onboarding and service recovery. The point is that AI needs the same operational discipline as any other important enterprise service.

I also helped move the gateway from a one-off delivery programme into a continuing service model, with an owned backlog, planned releases, operational work, platform improvements and a way for new requirements to enter the roadmap.

03

Governance should improve the route

Governance works best when it helps people reach a sound answer quickly.

I contribute to the AI governance operating model as well as the technical controls beneath it. That includes risk-proportionate intake, data classification, model and supplier review, recorded decisions, review points and ongoing assurance after something has been approved.

The governance forum should not treat every request as equally risky or stop at a binary yes or no. Ordinary use should follow a clear supported path. A request involving sensitive information, a new provider or greater autonomy should bring in the relevant expertise and make the additional decisions visible.

This is the same Centre of Excellence principle I use elsewhere: give the requestor access to people who understand architecture, security, operations, cost and the business outcome. Return a route forward, not an unexplained refusal.

Explore the Centre of Excellence approach →

04

Cost is part of the architecture

AI consumption can grow quickly, and the technical decision determines much of the cost. The model selected, provider route, amount of context, caching behaviour, connected tools and design of an agent can all change the cost of the same piece of work.

I built full cost allocation alongside the gateway rather than treating it as a later reporting exercise. Provider costs and token usage can be attributed through teams to the appropriate cost centres, giving finance a chargeback path and engineering useful showback at team and user level.

Detailed token data also makes efficiency work possible. We can examine model choice, context size, prompt and output patterns, caching and agent behaviour, then work with teams on the causes of inefficient consumption. The resulting token-efficiency programmes connect technical changes and working practices to measurable cost and performance outcomes.

The purpose is not to push everyone towards the cheapest model. It is to help people choose capability proportionate to the work and understand the value created by the spending.

Explore my FinOps approach →

05

Adoption depends on a useful supported path

People will use the governed route when it helps them succeed.

That means useful model choice, understandable onboarding, support when something does not work and a route for legitimate needs that fall outside the normal pattern. It also means learning from repeated questions and improving the platform instead of answering the same ticket indefinitely.

My developing earned-capability model extends that principle. Everyone should have a useful starting point. Access to more capable models, larger budgets or greater autonomy can then grow as people demonstrate that they can use them effectively and responsibly. The controls create a route to more capability rather than acting only as restrictions.

Read about earned AI capability →

06

The next frontier: tools and agents

AI is moving from generating an answer to taking action. Connecting models to enterprise tools through standards such as MCP creates useful possibilities, but it also changes the control problem.

The question is no longer only which model can see which information. It is also which identity an agent acts as, which systems it can reach, what actions it may take, where human approval is required and how the outcome can be audited or reversed.

I am applying the gateway and governance experience to that next stage: governed tool access, proportionate autonomy, clear ownership and controls that follow the action as well as the model request. This work is developing; the objective is to make agentic capability operable before it becomes fragmented across individual tools and teams.

What I bring

My contribution sits between strategy and operations.

I can discuss AI adoption, cost, governance and supplier direction with leadership, then work with technical teams on the access model, routing, lifecycle, operational controls and support needed to make the service real. I understand enough of each part to see how the decisions connect, and I bring in deeper expertise where the work needs it.

That is the role I value: understanding the whole system, helping people make the decision clear and building the way to operate it.