Skip to content

Conversation

@uvv-01
Copy link

@uvv-01 uvv-01 commented Feb 6, 2026

What does this PR do?

Adds a minimal FastAPI-based inference example using OpenVINO, aimed at helping users quickly serve models via a REST API.

resolved #33970

Why is this needed?

  • There is no simple FastAPI inference example in the repo
  • Users on Windows face setup friction with existing examples
  • This provides a clean, Python-only starting point

What’s included

  • FastAPI inference script
  • ImageNet labels
  • Simple project structure under examples/fastapi

Follow-ups

  • Improve documentation
  • Add model download automation
  • Add Linux + Docker notes

@uvv-01 uvv-01 requested a review from a team as a code owner February 6, 2026 17:25
@uvv-01 uvv-01 requested review from mlukasze and removed request for a team February 6, 2026 17:25
@sys-openvino-ci sys-openvino-ci added the ExternalPR External contributor label Feb 6, 2026
@uvv-01
Copy link
Author

uvv-01 commented Feb 7, 2026

@sys-openvino-ci @adk9 @dmatveev @tpwrules @mlukasze can you approve my workflow.

@uvv-01
Copy link
Author

uvv-01 commented Feb 9, 2026

.check

Copy link

@krgkaushik krgkaushik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! This is a clear and helpful example.

@uvv-01
Copy link
Author

uvv-01 commented Feb 9, 2026

@krgkaushik Thanks a lot for the review! Glad you found it helpful

@uvv-01
Copy link
Author

uvv-01 commented Feb 9, 2026

@mlukasze Hi,
This PR adds a FastAPI inference example under examples/ only.
CI workflows are awaiting approval.
PTAL when you get a chance — happy to address any feedback.
Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ExternalPR External contributor no-match-files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request] Minimal FastAPI REST inference example using OpenVINO Runtime

3 participants