AI Labs GitHub
Table of contents

On-device AI apps for Windows 11 (Copilot+ PC)

Overview5 min read

Windows 11 .NET WinUI 3 On-device AI License

Eleven small desktop apps whose AI runs on the PC, through the Windows AI APIs: the Phi Silica language model, on-device OCR, image description, and a local semantic index (AppContentIndexer). Each one shows what "the data stays on this device" can look like for an everyday business task: finance, fraud, HR, proof-of-execution audits, retail, radiology, personal knowledge.

Important

These are demos and prototypes, not products. All sample data is synthetic. Do not use the finance, fraud, HR or radiology apps to make real decisions.

Architecture

Every app is the same shape: a WinUI 3 window hosting a WebView2 page, and a C# host that exposes the Windows AI APIs through a small JSON bridge.

flowchart LR
  subgraph APP["Packaged app (MSIX)"]
    UI["WebView2 UI<br/>www/ : HTML, CSS, JS"] <-->|JSON bridge| HOST["WinUI 3 host (C#)<br/>MainWindow.xaml.cs"]
  end
  HOST --> LM["Phi Silica<br/>LanguageModel"]
  HOST --> OCR["TextRecognizer<br/>(OCR)"]
  HOST --> IDG["ImageDescriptionGenerator"]
  HOST --> IDX["AppContentIndexer<br/>(local semantic index)"]
  HOST --> PDF["PdfPig / fo-dicom<br/>(file parsing)"]
  LM & OCR & IDG & IDX --- NPU[("NPU of a<br/>Copilot+ PC")]

The design rule behind most of them:

Note

Code computes the facts, the model words them. Totals, ratios, dates and verification matrices come from deterministic code (visible in Finance, Fraud, POE Verification); LocalIQ additionally checks the answer's numbers and citations against the retrieved text. The on-device model writes the explanation. Each app README says what is and is not checked.

Details: docs/ARCHITECTURE.md.

Catalogue

# App One line Needs network?
1 Finance Copilot Statement + payslip + ID scan → financial profile (income, expenses, DTI, anomalies), narrative and chat No (font stylesheet only)
2 Local Fraud Investigator Transaction risk analysis, graph, cases, and policy Q&A over a local index No (font stylesheet only)
3 HR Recruiter Agent Role + résumé fit analysis with evidence quotes, interview questions, duplicate detection Only "fetch job posting from URL"
4 POE Verification Analyst PO ↔ invoice ↔ proof-of-execution matrix, reuse detection, photo quantity estimate No (font stylesheet only)
5 POE Photo Processor Blur other people's faces, stamp EXIF date/location, AI caption, ZIP export Yes: CDN libraries and OpenStreetMap geocoding
6 AI Shelf Auditor Retail shelf-execution assistant (React UI, on-device image description) No
7 Reading Room Assistant Radiology reading-room prototype (preset AI findings; on-device draft impressions) No (font stylesheet only)
8 HybridMed Lab triage: local structuring, then an optional cloud stage on your Azure endpoint Only the cloud stage you configure
9 LocalIQ "Ask your files": any file type, hybrid retrieval, cited and verified answers No
10 LocalMind Private ChatGPT-style assistant: chat, branches, memory, RAG, skills, images No
11 HybridMind LocalMind + router: local first, your cloud model on consent, redaction, agent mode Only the cloud/agent you configure (tested against a mock only)

Each app folder has a README with a flow diagram, a source-file table, deployment command and a "Try it" list.

Step by step: run an app

flowchart LR
  A[Copilot+ PC<br/>Windows 11] --> B[Install .NET SDK + Git]
  B --> C[git clone]
  C --> D["scripts/build-app.ps1<br/>-App LocalMindApp"]
  D --> E[Trust the .cer<br/>once, as admin]
  E --> F[Add-AppxPackage]
  F --> G[Launch + sample data]
PowerShell
# 1. tools (once)
winget install --id Microsoft.DotNet.SDK.8
winget install --id Git.Git

# 2. code
git clone https://github.com/medyabi/windows-local-ai-apps.git
cd windows-local-ai-apps

# 3. build a signed MSIX with a self-signed certificate that the script creates for you
.\scripts\build-app.ps1 -App LocalMindApp

# 4. trust that certificate (elevated PowerShell, once per PC)
Import-Certificate -FilePath .\dist\LocalMindApp\LocalMindApp.cer -CertStoreLocation Cert:\LocalMachine\TrustedPeople

# 5. install
Add-AppxPackage -Path (Get-ChildItem .\dist\LocalMindApp\*.msix).FullName

Then start the app from the Start menu. The full guide (checks, certificates, first launch, update/uninstall, troubleshooting) is docs/DEPLOYMENT.md. Build internals and the developer loop: docs/BUILD.md.

No binaries are published here on purpose: you build with your own certificate, so nobody has to trust someone else's.

Requirements

OS Windows 11, build 22621 or later, x64
AI features A PC that supports the Windows AI APIs: a Copilot+ PC with an NPU (Phi Silica, OCR, image description). Without it the apps start but report the model as unavailable.
Build .NET SDK 8 or newer (built and tested with SDK 9.0 targeting net8.0); NuGet restores the Windows App SDK 2.2.2-experimental9 and Microsoft.Windows.SDK.BuildTools 10.0.26100.4654; internet for the first build
Not needed Visual Studio, Developer Mode

Privacy and network behaviour (measured from the source, not promised)

The AI inference in every app is on-device. Beyond that:

App Outbound network use
Finance, Fraud, POE Verification, Reading Room, HR, HybridMed A Google Fonts stylesheet is requested by the page (cosmetic; fonts fall back offline). Your data is not part of that request.
HR Recruiter Plus: the page asks the host to download a job-posting URL only when you use "fetch from URL".
POE Photo Processor face-api.js + model weights, exifr, JSZip from CDNs; GPS coordinates (and typed addresses) sent to OpenStreetMap Nominatim for geocoding. Photos are not uploaded.
HybridMed If you enter an Azure endpoint and key: the stage-1 structured output goes to that endpoint (a fetch from the page).
HybridMind Cloud calls go only to the endpoint you configure, made by the host, after consent and redaction. Optional local agent on loopback.
Finance Copilot Its "Prove it" panel is a static statement of the design (counters are fixed text), not a live network monitor.
AI Shelf Auditor, LocalIQ, LocalMind None found in the source (the AI Shelf bundle is minified and was not audited line by line).

Windows itself may download or update the on-device models (Windows Update).

Licence

MIT. Third-party components: THIRD-PARTY.md.

View the source on GitHub