AI-RESIDENCY · Path 4: Build and operate
Sovereign AI Architecture Residency
Five days in the lab that end not with slides but with your own architecture design, validated on real hardware.
- Duration
- 5 days in the lab
- Group
- up to 8 people
- Format
- In the lab
- Language
- German or English
- Price
- €44,500 flat, plus VAT
Who this track is for
The core team of an organization concretely planning a sovereign AI platform: architects, platform owners and the person who has to defend the investment. Up to 8 participants from one company, this is not an open event with a mixed audience.
Who it is not for
Not for teams still building fundamentals or comparing options across vendors. For that, Sovereign AI Platform Engineering (AI-PLATFORM) as a course and the Sovereign AI Executive Briefing (AI-EXEC) for the leadership level are the right fit.
Starting situation
An investment decision is on the table that may reach six or seven figures: your own GPU platform, sizing, operating model, make or buy. There are plenty of paper concepts, but the critical assumptions were never checked against real hardware. Before anything is ordered, the design should be thought through, calculated and tested for real at the decisive points.
This exists after the track
- An architecture and operations design for your platform, in your structure and with your requirements, not a generic template
- Validated core assumptions: sizing, throughput and response times of your target workloads, measured on GPU systems of our lab from L40S to H100
- A tested slice: one prioritized use case of your organization runs end to end on the lab environment by the end of the week
- A prioritized implementation backlog with effort classes, dependencies and named risks
- An executive readout on day 5: design, measurements and investment picture in 90 minutes for your leadership level, with a takeaway document
Prerequisites
A decision-ready initiative and a team that carries it: at least one architect or platform owner with infrastructure depth. Prior attendance of AI-PLATFORM helps but is not required.
Preparation before the track
Two weeks before the residency we hold a 90-minute preliminary call: target picture, candidate workloads, regulatory framework, existing documents. You name the three assumptions your initiative depends on and provide anonymized sample data for the slice, as far as releasable.
What's included
- 5 days of exclusive work in the enterprise lab with Dino Bordonaro, no parallel operation with other customers
- Reserved GPU systems of several classes for comparative measurements, from the cluster with 2,516 cores, 24 TB RAM and 3,400 TB storage
- A 90-minute preliminary call and preparation of your documents before the week
- Architecture and operations design, measurement protocols and backlog as handover-ready documents
- Executive readout deck for your leadership level
- Two 60-minute follow-up sessions in the 8 weeks after the residency
Agenda
Day 1
Target picture and the three critical assumptions
Your initiative on one wall: workloads, users, data classes, regulatory framework. The assumptions named in the preliminary call are sharpened and translated into measurable verification criteria.
Requirements with veto power
Data protection, security and operations state their hard limits before the architecture is drawn: what must the system never do, which evidence up to VS-NfD should be preparable, who will carry operations?
Slice selection: a case that proves something
From your candidate workloads the use case is chosen that tests the riskiest assumption, not the most convenient one. The bar is set: how do we recognize on Friday that the slice holds?
First measurement run: baseline on lab hardware
Your target models run on the reserved GPU systems for the first time. Baseline measurement of throughput and latency as the reference for every decision of the week.
Day result: verified target picture and measurement plan
Target picture, hard limits, the selected slice and a measurement plan for the three critical assumptions exist in writing and are carried by the whole team.
Day 2
Architecture design: the load-bearing decisions
Compute, network, storage, identity, registry, inference stack: the design takes shape on the wall, every layer with reasoning and an alternative. Azure Local and Azure Arc are planned in where they carry weight, in the version available at the time.
Sizing calculation against the baseline
The capacity model is calculated with the baseline values from day 1: how many cards of which class, from L40S to H100, for your peak loads? The gap between vendor claims and your own measurements is quantified.
Validation: assumptions one and two under test
The first two critical assumptions are checked on the hardware, for example quantization effects on your quality requirement or concurrency behavior under realistic load. Results flow straight back into the design.
The operating model switch
Connected, intermittently disconnected, or initiate the disconnected eligibility check: decided against the criteria catalog, with an honest framing of the eligibility prerequisites of Azure Local Disconnected Operations.
Day result: robust architecture design v1
The design exists in version 1, with a sizing calculation based on your own measurements and a documented operating model decision including open verification points.
Day 3
Slice build: the foundation
Building the slice on the lab environment along the design: identity integration, network segment, registry connection with signature verification. Your team builds, the trainer keeps design and reality aligned.
Slice build: data and application logic
Your anonymized sample data meets the stack: preparation, indexing or integration depending on the case, plus the application layer. Where it honestly fits, patterns from Sovereign Assistant or VOXA serve as references.
First end-to-end run
The slice answers end to end for the first time: from authenticated request to a substantiated answer. Whatever jams is logged and prioritized instead of talked up.
Day result: end-to-end slice
The use case runs end to end on the lab environment. Deviations from the design are logged and scheduled for day 4.
Day 4
Assumption three and the load test
The remaining critical assumption is tested, then the slice faces a load test against the bar from day 1: throughput, latency, behavior at the capacity limit. Every deviation gets a cause or a backlog item.
Operations and security drill
The slice is treated like production: a monitoring view is built, a model rollback is rehearsed, a prompt injection attempt is run against the protection layer. Results flow into the operations design.
Backlog prioritization
Everything open becomes a backlog with effort classes, dependencies and risks: the path from validated slice to productive platform, prioritized by the team, not the trainer.
Investment picture and make or buy
Sizing, operating model and backlog are condensed into an investment picture: self-build, Sovereign AI Appliance or a mixed path, with numbers and named uncertainties for the readout.
Day result: validated design with backlog
Architecture and operations design exist in a verified version, all three critical assumptions are answered with measurements, the backlog is prioritized.
Day 5
Hardening the design
A final review round with swapped roles: the team attacks its own design, the trainer defends it, and vice versa. Whatever does not survive the attack is changed or documented as a risk.
Readout rehearsal
The executive readout is rehearsed once in full: key messages, measurements, investment picture, recommendation. The team decides who presents which part to its own leadership.
Document handover
Design, measurement protocols, backlog and readout deck are finalized and handed over. All artifacts belong to you and remain usable without BORDONARO.
Executive readout
90 minutes in front of your leadership level, on site in the lab or joining remotely: the validated design, a live demonstration of the slice, the investment picture and the recommendation with open risks. Questions are answered by the team, not just the trainer.
Final result: decision basis handed over
Your leadership has seen a validated design with measurements, a tested slice and a prioritized backlog. Next steps and the two follow-up sessions are scheduled.
Exercises and lab share
The entire week takes place in the lab: baseline and comparative measurements on several GPU classes, the complete slice build, load test, rollback rehearsal and a prompt injection attempt all run on reserved systems of the cluster.
Platforms
Delivered exclusively in the enterprise lab on reserved hardware. Azure Local, Azure Arc and Foundry Local are used in the version available at the time, preview states are labeled as such, and Disconnected Operations is treated as an access-restricted offering with an eligibility check. Your sample data stays on dedicated systems and is verifiably deleted after the week.
Transfer evidence
The transfer evidence is the executive readout itself: your team presents design, measurements and recommendation to its own leadership and answers their questions. All validations are documented as measurement protocols and are part of the handover.
Artifacts you take home
- Architecture and operations design in a handover-ready version
- Measurement protocols of the validated assumptions including GPU comparison values
- Tested slice as a documented reference implementation on the lab environment
- Prioritized implementation backlog with effort classes and risks
- Executive readout deck with investment picture
Optional extensions
- Sovereign AI Platform Engineering (AI-PLATFORM) to train the wider team along the design
- LLMOps for Connected, Disconnected and Air-Gapped Environments (AI-OPS) if the disconnected operating model is chosen
- Sovereign AI Appliance and implementation support as separate services if the readout leads to a buy decision
Boundaries
The residency produces and validates a design, it is not an implementation in your data center and not an ongoing consulting mandate. Implementation, procurement support and operations are separate services and are contracted separately.
Frequently asked questions
What justifies €44,500 compared to the AI-PLATFORM course?
The course teaches transferable skills on a reference scenario. The residency works five days exclusively on your initiative: your design, your data, your measurements, reserved hardware of several GPU classes and a readout in front of your leadership. Measured against a GPU mispurchase or a concept project of equal depth, the price of €44,500 plus VAT is calculated soberly.
Does our executive team have to attend all five days?
No. The week is carried by your technical team of up to 8 people. The leadership level is needed for the 90-minute executive readout on day 5, on site or joining remotely. In our experience, anyone who additionally attends day 1 understands the readout considerably faster.
How confidential are our design and our data?
We sign a non-disclosure agreement before the residency. You provide only anonymized, released sample data, which stays on dedicated systems and is verifiably deleted after the week. All results belong to you, and BORDONARO does not use them as a reference without your written approval.