Synchronous pattern

Usecase

Architecture

The synchronous pattern is used to run prediction synchronously. It blocks the process until the prediction finishes. If you develop the inference server with REST or GRPC, it often becomes the synchronous pattern. This is one of the easiest patterns to use for you can consider its workflow in simple step-by-step.

Diagram

diagram

Pros

Cons

Needs consideration