beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-06-11 18:39:17,485 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-06-11 18:39:19,654 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=5036) INFO 2026-06-11 18:39:22,124 proxy 172.17.0.2 -- Proxy starting on node e1807951c3379cdc6badc06fdd39f18f25820648f7577f38951baa1b (HTTP port: 8000).
INFO 2026-06-11 18:39:22,197 serve 4223 -- Started Serve in namespace "serve".
(ProxyActor pid=5036) INFO 2026-06-11 18:39:22,194 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5034) INFO 2026-06-11 18:39:22,290 controller 5034 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5034) INFO 2026-06-11 18:39:22,291 controller 5034 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5036) INFO 2026-06-11 18:39:22,295 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5036) INFO 2026-06-11 18:39:22,302 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f034c7db4c0>.
(ServeController pid=5034) INFO 2026-06-11 18:39:22,395 controller 5034 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5036) INFO 2026-06-11 18:39:26,420 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-06-11 18:39:27,322 serve 4223 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,435 mnist_classifier_MNISTClassifier ywrat4p0 ca296009-770d-41cd-a623-66342caaa717 -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,440 mnist_classifier_MNISTClassifier ywrat4p0 c88aea29-ca29-4b4d-89d4-a460f2b058d2 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,440 mnist_classifier_MNISTClassifier ywrat4p0 6bc92048-0cc3-4ad1-8c10-161e47803ed2 -- POST / 200 424.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,441 mnist_classifier_MNISTClassifier ywrat4p0 487eb2b8-bf02-4a27-9c3a-11aed02a723b -- POST / 200 424.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,442 mnist_classifier_MNISTClassifier ywrat4p0 d75f5d64-c419-48f3-8a74-63b4f1300a30 -- POST / 200 423.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,442 mnist_classifier_MNISTClassifier ywrat4p0 4a9d0682-3d7f-4396-b4eb-9701fcd3f4da -- POST / 200 422.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,443 mnist_classifier_MNISTClassifier ywrat4p0 48259054-def6-470b-a97d-0af09e4971a9 -- POST / 200 422.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,444 mnist_classifier_MNISTClassifier ywrat4p0 030ba9ee-beff-42d9-b32b-d8b0b2ff7758 -- POST / 200 422.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,445 mnist_classifier_MNISTClassifier ywrat4p0 802259c6-3c27-40db-ba11-67f650718ad9 -- POST / 200 424.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,446 mnist_classifier_MNISTClassifier ywrat4p0 0603f1ed-c506-4d5a-940c-677d0de3d381 -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,446 mnist_classifier_MNISTClassifier ywrat4p0 93c59454-b95f-4919-a2ea-04d5866076e1 -- POST / 200 422.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,449 mnist_classifier_MNISTClassifier ywrat4p0 11e26a79-0890-4b83-b72b-927ca6e3f152 -- POST / 200 424.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,451 mnist_classifier_MNISTClassifier ywrat4p0 273f85d1-66e4-41d2-abb3-a31e871243a4 -- POST / 200 424.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,455 mnist_classifier_MNISTClassifier ywrat4p0 a21e1248-68da-45ef-a7ce-a1a61c275d9f -- POST / 200 427.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,455 mnist_classifier_MNISTClassifier ywrat4p0 197ffe71-0d7b-48c7-b1c3-0b1721a3a318 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,456 mnist_classifier_MNISTClassifier ywrat4p0 7b1115fe-2703-49d0-894e-ee254131a428 -- POST / 200 426.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,458 mnist_classifier_MNISTClassifier ywrat4p0 d7157a54-a201-4ea0-965b-41b7cccc04e6 -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,460 mnist_classifier_MNISTClassifier ywrat4p0 812c7c76-f117-456a-b216-9877171a63a8 -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,461 mnist_classifier_MNISTClassifier ywrat4p0 9a26a1a4-5a5e-4d6e-8872-46fd279003db -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,462 mnist_classifier_MNISTClassifier ywrat4p0 245a300f-361c-4539-ba21-b4bf36c33fc2 -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,462 mnist_classifier_MNISTClassifier ywrat4p0 bbe8a669-8572-4db8-b241-4318cc14bba7 -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,464 mnist_classifier_MNISTClassifier ywrat4p0 47b57866-dfd2-4137-835c-5d386e2fa5bf -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,465 mnist_classifier_MNISTClassifier ywrat4p0 1335660a-3495-42d6-babb-b71e46a9a16f -- POST / 200 428.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,466 mnist_classifier_MNISTClassifier ywrat4p0 6021287f-34ec-44f0-9984-4c0a0c6f93c6 -- POST / 200 428.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,471 mnist_classifier_MNISTClassifier ywrat4p0 e119e277-84b4-4185-bdf3-fd1ca550b672 -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,471 mnist_classifier_MNISTClassifier ywrat4p0 1170ef6b-6411-4a3b-924c-5a66b67c197f -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,473 mnist_classifier_MNISTClassifier ywrat4p0 9b198df0-f718-469c-8e83-173a7a6af24a -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,473 mnist_classifier_MNISTClassifier ywrat4p0 da79e657-df96-4b97-905d-6db628924f84 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,473 mnist_classifier_MNISTClassifier ywrat4p0 fbda18d0-bc91-476b-8a1f-21235217cbda -- POST / 200 427.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,513 mnist_classifier_MNISTClassifier ywrat4p0 b654d59d-1140-40cc-9dbe-b6152e9c88d3 -- POST / 200 466.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,523 mnist_classifier_MNISTClassifier ywrat4p0 f1f2b4e1-4ff4-4e37-8e53-e31ccbdcbbe4 -- POST / 200 476.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,524 mnist_classifier_MNISTClassifier ywrat4p0 6c34de0f-c7e5-4244-a882-9baeb4f454da -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,524 mnist_classifier_MNISTClassifier ywrat4p0 5defbbe2-0264-4a23-9ec6-de25638488c0 -- POST / 200 476.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,525 mnist_classifier_MNISTClassifier ywrat4p0 93dd3cc4-5dc4-414a-adac-35397647fe00 -- POST / 200 475.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,526 mnist_classifier_MNISTClassifier ywrat4p0 c4e0f4ce-0dce-4ba4-8a63-78e9d209d819 -- POST / 200 476.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,528 mnist_classifier_MNISTClassifier ywrat4p0 4cec198d-bf1c-4ad1-b2c9-fed8748bc981 -- POST / 200 477.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,529 mnist_classifier_MNISTClassifier ywrat4p0 ef2cc477-ede4-471a-aff4-4e2f3bd142ee -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,531 mnist_classifier_MNISTClassifier ywrat4p0 0a2b6026-6fe8-435d-9cff-4be62b709f80 -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,532 mnist_classifier_MNISTClassifier ywrat4p0 ac6e8510-a753-4b67-a678-cf436e756ac8 -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,603 mnist_classifier_MNISTClassifier ywrat4p0 13f2b7e3-6dc8-4d0e-acf9-48a2fccab754 -- POST / 200 549.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,606 mnist_classifier_MNISTClassifier ywrat4p0 0b8d3206-bd4a-466b-bdf7-d5e3415ac0ab -- POST / 200 551.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,610 mnist_classifier_MNISTClassifier ywrat4p0 481d50c6-ec2e-4b48-81ec-e66837fa0543 -- POST / 200 554.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,612 mnist_classifier_MNISTClassifier ywrat4p0 2c8a8174-0744-4f00-ae78-4d5553dca45f -- POST / 200 552.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,613 mnist_classifier_MNISTClassifier ywrat4p0 41165728-c31a-4f34-809d-d81d0d3f4053 -- POST / 200 552.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,613 mnist_classifier_MNISTClassifier ywrat4p0 988dff2d-8a5c-47e0-83bf-deb974a576c5 -- POST / 200 552.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,613 mnist_classifier_MNISTClassifier ywrat4p0 a51411e5-bb76-406b-83b6-f5c9ded15aff -- POST / 200 551.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,614 mnist_classifier_MNISTClassifier ywrat4p0 aae1266f-8ef6-4294-ae3f-d1f238aad293 -- POST / 200 551.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,614 mnist_classifier_MNISTClassifier ywrat4p0 46d1adba-9c4f-49f0-81d2-4e57c60675c4 -- POST / 200 551.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,614 mnist_classifier_MNISTClassifier ywrat4p0 87462ab2-efac-468f-9adf-f7a7b724851f -- POST / 200 550.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,619 mnist_classifier_MNISTClassifier ywrat4p0 514a52db-4d83-4adb-a9d5-84aecf9cbace -- POST / 200 553.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,620 mnist_classifier_MNISTClassifier ywrat4p0 80880381-bf4c-4bd9-a1ee-97386c95d891 -- POST / 200 553.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,621 mnist_classifier_MNISTClassifier ywrat4p0 878a1a45-a218-4e7f-b0e5-b5ef1320a425 -- POST / 200 551.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,622 mnist_classifier_MNISTClassifier ywrat4p0 3120885e-e146-4474-ae48-07a59d3e388b -- POST / 200 552.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,623 mnist_classifier_MNISTClassifier ywrat4p0 e1d1903a-10a3-430c-b03a-3767d77b9c9e -- POST / 200 549.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,623 mnist_classifier_MNISTClassifier ywrat4p0 97199a2f-d87e-4474-a3e0-152e4d118259 -- POST / 200 550.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,624 mnist_classifier_MNISTClassifier ywrat4p0 a13fff8c-a197-4ca2-8f15-b398f9e5153d -- POST / 200 550.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,626 mnist_classifier_MNISTClassifier ywrat4p0 69760cf1-2181-42c6-8238-962b7591e075 -- POST / 200 551.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,629 mnist_classifier_MNISTClassifier ywrat4p0 32b4b0d1-fbdb-4657-bd86-ff85e1ac3846 -- POST / 200 553.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,630 mnist_classifier_MNISTClassifier ywrat4p0 75835449-9dc2-4723-9946-3b6af046ef2f -- POST / 200 554.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,631 mnist_classifier_MNISTClassifier ywrat4p0 c9f7653a-18ae-44a9-9c72-5cc9b34fe984 -- POST / 200 554.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,631 mnist_classifier_MNISTClassifier ywrat4p0 9cd08b79-7083-442d-8f10-3a75228a4b0f -- POST / 200 554.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,632 mnist_classifier_MNISTClassifier ywrat4p0 e684a20b-a36e-4442-89e1-7c27ab0b6522 -- POST / 200 554.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,632 mnist_classifier_MNISTClassifier ywrat4p0 a9dea62b-fd3d-4395-831f-921514dfd37d -- POST / 200 553.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,633 mnist_classifier_MNISTClassifier ywrat4p0 1233caa4-7423-4f8f-ae10-8481213ee012 -- POST / 200 551.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,634 mnist_classifier_MNISTClassifier ywrat4p0 11768219-f7ad-4b71-8440-b5f56a9cd3c7 -- POST / 200 551.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,634 mnist_classifier_MNISTClassifier ywrat4p0 14c7a2e8-8ff0-43cc-b6c2-00d93fec619e -- POST / 200 550.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,635 mnist_classifier_MNISTClassifier ywrat4p0 ee7390d8-cb98-4dd3-a81c-13609097590b -- POST / 200 549.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,636 mnist_classifier_MNISTClassifier ywrat4p0 3ac7d872-8e51-47c5-b535-e0bed37eb223 -- POST / 200 547.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,636 mnist_classifier_MNISTClassifier ywrat4p0 9f613cd4-ef2b-481f-b530-b2d73922147c -- POST / 200 547.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,636 mnist_classifier_MNISTClassifier ywrat4p0 fd2b7374-d18b-48a4-bb39-3c7594fbc502 -- POST / 200 544.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,640 mnist_classifier_MNISTClassifier ywrat4p0 c9c773f2-a6f0-41b3-a713-18680289b7f6 -- POST / 200 548.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,643 mnist_classifier_MNISTClassifier ywrat4p0 075fc516-5e63-42c6-991d-926e1eff0ac0 -- POST / 200 550.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,643 mnist_classifier_MNISTClassifier ywrat4p0 70e772b3-374f-4cf3-94ec-795a856d1dbf -- POST / 200 551.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,644 mnist_classifier_MNISTClassifier ywrat4p0 bdd80f6b-c013-40a0-93cb-a31e7a88d384 -- POST / 200 550.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,644 mnist_classifier_MNISTClassifier ywrat4p0 ae3a3837-bbb3-488c-bae3-3bdd4ea8d37c -- POST / 200 551.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,645 mnist_classifier_MNISTClassifier ywrat4p0 d329ab15-1d9e-4166-b705-1151759b9a1c -- POST / 200 551.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,645 mnist_classifier_MNISTClassifier ywrat4p0 c98eef66-fe6e-4586-96a4-96f57b28ea26 -- POST / 200 551.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,646 mnist_classifier_MNISTClassifier ywrat4p0 9e8587b8-4b2c-4121-bfe9-56f1a25f192f -- POST / 200 550.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,646 mnist_classifier_MNISTClassifier ywrat4p0 4824128f-8cbc-419d-b118-c5faef458f71 -- POST / 200 549.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,648 mnist_classifier_MNISTClassifier ywrat4p0 62ea9c9d-f1f7-4925-9cea-c8e600b4ce38 -- POST / 200 549.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,648 mnist_classifier_MNISTClassifier ywrat4p0 89bd65fa-e39a-4ea3-936a-e35d7d337400 -- POST / 200 547.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,648 mnist_classifier_MNISTClassifier ywrat4p0 b4b6d76f-081d-4d3b-9fb7-1c1b2a56e9f2 -- POST / 200 545.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,654 mnist_classifier_MNISTClassifier ywrat4p0 497c9805-6ba5-4241-82e6-ecc3e7b6d684 -- POST / 200 551.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,655 mnist_classifier_MNISTClassifier ywrat4p0 989bd397-1165-45e5-a1b6-f95fd11e63d8 -- POST / 200 552.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,655 mnist_classifier_MNISTClassifier ywrat4p0 047d94b8-4511-461c-949a-ec92ab4102ea -- POST / 200 550.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,656 mnist_classifier_MNISTClassifier ywrat4p0 d0af7fe1-5d9a-4110-bdc6-a8aa5dcd266f -- POST / 200 550.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,658 mnist_classifier_MNISTClassifier ywrat4p0 1a8ebf61-af1d-4705-9791-f56a67fda898 -- POST / 200 552.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,660 mnist_classifier_MNISTClassifier ywrat4p0 d78de0ce-23ac-4229-984c-d1ddb96c7aac -- POST / 200 553.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,661 mnist_classifier_MNISTClassifier ywrat4p0 f70d5053-34b3-4a3b-9d32-d5a4d31e7a8b -- POST / 200 550.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,662 mnist_classifier_MNISTClassifier ywrat4p0 92f1edb3-cac2-4e68-bfa3-adcf882b4252 -- POST / 200 551.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,663 mnist_classifier_MNISTClassifier ywrat4p0 3cb8516f-2e52-493a-90cb-d8fdae94e316 -- POST / 200 550.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,663 mnist_classifier_MNISTClassifier ywrat4p0 dca97ef9-f131-4d4a-86a2-118386bbecce -- POST / 200 548.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,666 mnist_classifier_MNISTClassifier ywrat4p0 6d5ca3df-b729-470e-bf5c-f0bc58ddd78f -- POST / 200 548.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,879 mnist_classifier_MNISTClassifier ywrat4p0 666ce2f4-7538-44bb-a245-360702b5d70c -- POST / 200 761.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,881 mnist_classifier_MNISTClassifier ywrat4p0 8e004429-396f-4050-9dbb-42fb38eb8409 -- POST / 200 765.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,883 mnist_classifier_MNISTClassifier ywrat4p0 c0eb9bf4-128b-48da-924c-8c5a73d5f6cb -- POST / 200 759.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,886 mnist_classifier_MNISTClassifier ywrat4p0 27a24093-7741-4086-a626-7058e5b7da54 -- POST / 200 766.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,888 mnist_classifier_MNISTClassifier ywrat4p0 5fa6300b-ba23-4e4b-befe-954c5c54d468 -- POST / 200 764.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,891 mnist_classifier_MNISTClassifier ywrat4p0 11de6a26-3ee7-4457-b3ed-81976be51824 -- POST / 200 763.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,895 mnist_classifier_MNISTClassifier ywrat4p0 667de7ff-732a-43bb-a7a9-08867f8c00f7 -- POST / 200 767.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,896 mnist_classifier_MNISTClassifier ywrat4p0 eafb425f-34f8-4637-864c-3b2a7431cd59 -- POST / 200 441.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,899 mnist_classifier_MNISTClassifier ywrat4p0 9663de85-059d-4eb7-9dba-7cdb8af8597b -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,900 mnist_classifier_MNISTClassifier ywrat4p0 394ffeb9-2b28-4bb1-8f01-9d2dcdb99ce4 -- POST / 200 456.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,901 mnist_classifier_MNISTClassifier ywrat4p0 56133782-3ea8-4fc9-8c4b-d464341387cf -- POST / 200 437.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,903 mnist_classifier_MNISTClassifier ywrat4p0 8a175a97-85eb-416f-ba98-bd0546336524 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,905 mnist_classifier_MNISTClassifier ywrat4p0 590d0908-cb3d-4ac5-9290-fb18b8d320bc -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,911 mnist_classifier_MNISTClassifier ywrat4p0 139a7ec4-6281-4862-b3f7-4f5146a5f512 -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,912 mnist_classifier_MNISTClassifier ywrat4p0 f1db0931-fc1f-47ff-89e6-4d2308e78b71 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,913 mnist_classifier_MNISTClassifier ywrat4p0 d7c6f934-05a9-44cf-9455-0874c331b326 -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,914 mnist_classifier_MNISTClassifier ywrat4p0 5a8e7d6b-6b71-439e-8d6e-6410b9cf252d -- POST / 200 436.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,916 mnist_classifier_MNISTClassifier ywrat4p0 22c952c5-d99d-43d4-81d0-9b9cb6b76c6b -- POST / 200 436.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,917 mnist_classifier_MNISTClassifier ywrat4p0 e82fa9c2-5dfd-4fe4-b87d-f03a6e0562ea -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,921 mnist_classifier_MNISTClassifier ywrat4p0 e42a4917-f739-4b2c-97ef-ae90dcfcd13b -- POST / 200 439.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,923 mnist_classifier_MNISTClassifier ywrat4p0 0fd5d2f1-144a-420f-9543-41bc50bd00aa -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,924 mnist_classifier_MNISTClassifier ywrat4p0 74ca37db-a1ad-40f9-b901-b31a981f35cb -- POST / 200 440.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,925 mnist_classifier_MNISTClassifier ywrat4p0 fc5b48fd-2abf-429c-a2bc-1f29bd0bbb1e -- POST / 200 440.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,927 mnist_classifier_MNISTClassifier ywrat4p0 154f192d-a447-4ee6-b1a8-ea5c7d4e8da4 -- POST / 200 440.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,930 mnist_classifier_MNISTClassifier ywrat4p0 3348b745-c361-404f-a1c6-0b814d3a1d9e -- POST / 200 441.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,935 mnist_classifier_MNISTClassifier ywrat4p0 f18d2121-8a71-4a70-8345-eb55756508eb -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,942 mnist_classifier_MNISTClassifier ywrat4p0 ab615f39-e449-425b-96b2-671323bdb987 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,944 mnist_classifier_MNISTClassifier ywrat4p0 4eb878d1-c98b-4c1c-b17c-fab7fa232e56 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,945 mnist_classifier_MNISTClassifier ywrat4p0 c57d6122-c1c3-49a5-85ae-05b96034f785 -- POST / 200 400.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:28,948 mnist_classifier_MNISTClassifier ywrat4p0 4bc5e874-13b6-446c-9585-ddf9a211b804 -- POST / 200 396.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,064 mnist_classifier_MNISTClassifier ywrat4p0 8dd9d788-4672-4a00-bf1a-12d867af0f56 -- POST / 200 508.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,066 mnist_classifier_MNISTClassifier ywrat4p0 d74b7e89-f8f7-4bff-b79b-5c1aa95031e4 -- POST / 200 511.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,066 mnist_classifier_MNISTClassifier ywrat4p0 60f23f87-60dd-411b-b8ef-aadd595ada77 -- POST / 200 511.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,067 mnist_classifier_MNISTClassifier ywrat4p0 4fcba62d-6e3f-4b24-917f-2448e0abb986 -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,067 mnist_classifier_MNISTClassifier ywrat4p0 31e97419-2bfa-4feb-86d3-a8168e957014 -- POST / 200 510.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,068 mnist_classifier_MNISTClassifier ywrat4p0 8ae8b70c-6071-470a-a295-f2b5d3a4f279 -- POST / 200 509.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,069 mnist_classifier_MNISTClassifier ywrat4p0 6f491d97-8708-4edb-9363-5c387c294aeb -- POST / 200 510.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,069 mnist_classifier_MNISTClassifier ywrat4p0 6f26f448-da41-4d73-a876-ee589a7b2651 -- POST / 200 510.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,071 mnist_classifier_MNISTClassifier ywrat4p0 6122f010-186f-4430-b41c-d9e3c21ef698 -- POST / 200 507.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,072 mnist_classifier_MNISTClassifier ywrat4p0 b13df958-9a16-4960-b4b8-c520bbeb8c35 -- POST / 200 506.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,072 mnist_classifier_MNISTClassifier ywrat4p0 f0dd362f-df85-4f06-9dd0-bc351e4c93db -- POST / 200 506.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,073 mnist_classifier_MNISTClassifier ywrat4p0 94f4b019-746d-423a-a9c0-4ba1acad77b9 -- POST / 200 507.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,073 mnist_classifier_MNISTClassifier ywrat4p0 2a8e5e0d-c8f7-4106-9de1-370c73182fdb -- POST / 200 507.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,074 mnist_classifier_MNISTClassifier ywrat4p0 8e29835b-824b-408c-8381-2dce7669b415 -- POST / 200 507.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,075 mnist_classifier_MNISTClassifier ywrat4p0 8312bbf5-8ba0-4406-b9cd-2a0451dcd7a0 -- POST / 200 508.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,076 mnist_classifier_MNISTClassifier ywrat4p0 d639b78d-c604-4af2-a7a4-13a11da3bd1a -- POST / 200 509.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,076 mnist_classifier_MNISTClassifier ywrat4p0 e5f28343-4fe9-4ed1-a149-a91f01cba3a7 -- POST / 200 436.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,077 mnist_classifier_MNISTClassifier ywrat4p0 e5587829-7c10-4af4-b0ed-a7a1d5cb9ea5 -- POST / 200 437.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,079 mnist_classifier_MNISTClassifier ywrat4p0 edd1cabe-9289-43f6-acf7-8b5169bc14b4 -- POST / 200 439.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,081 mnist_classifier_MNISTClassifier ywrat4p0 3ffa0050-4dfe-478f-8871-3879fc2ac809 -- POST / 200 427.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,083 mnist_classifier_MNISTClassifier ywrat4p0 6355b53e-45b4-4607-82c2-9eee58f01215 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,084 mnist_classifier_MNISTClassifier ywrat4p0 ffcbe6ea-6ff9-476a-8bc8-6c03d3ee8c77 -- POST / 200 418.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,086 mnist_classifier_MNISTClassifier ywrat4p0 9bf620cd-53e3-4797-8ea1-f0480360c146 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,086 mnist_classifier_MNISTClassifier ywrat4p0 59962392-d8eb-43f3-b6eb-965d7a31b863 -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,087 mnist_classifier_MNISTClassifier ywrat4p0 260ae694-b85d-4d40-b214-278b8fe79398 -- POST / 200 413.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,087 mnist_classifier_MNISTClassifier ywrat4p0 63c868c2-303b-419a-b446-665897cea171 -- POST / 200 412.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,088 mnist_classifier_MNISTClassifier ywrat4p0 4166efeb-afe5-4615-9d7b-d006c472e45f -- POST / 200 411.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,088 mnist_classifier_MNISTClassifier ywrat4p0 0ff01c7e-13e6-4fff-9078-defd8f4aa7c2 -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,089 mnist_classifier_MNISTClassifier ywrat4p0 e6a76a05-deff-46f9-b303-52c7a490504d -- POST / 200 411.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,089 mnist_classifier_MNISTClassifier ywrat4p0 f3bd57ff-c04f-49da-a089-59d536a67885 -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,089 mnist_classifier_MNISTClassifier ywrat4p0 31bafe90-f706-4766-9dd6-44de2fd322ec -- POST / 200 409.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,089 mnist_classifier_MNISTClassifier ywrat4p0 21102a99-bd2e-4109-9eee-0250ae0e4180 -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,090 mnist_classifier_MNISTClassifier ywrat4p0 7ea65bcc-eaac-462e-9621-62a7081bcef0 -- POST / 200 408.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,090 mnist_classifier_MNISTClassifier ywrat4p0 fab509dd-a16d-4bb7-9087-b675766646a9 -- POST / 200 408.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,090 mnist_classifier_MNISTClassifier ywrat4p0 a387f939-3965-4a28-a7dd-0dc9e2e1dc7b -- POST / 200 407.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,091 mnist_classifier_MNISTClassifier ywrat4p0 720f6ea2-4f75-46a1-83d4-3747a824e8fa -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,091 mnist_classifier_MNISTClassifier ywrat4p0 8545f93c-5618-4e30-880e-4229bc8b7780 -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,091 mnist_classifier_MNISTClassifier ywrat4p0 128833b1-adda-4118-aa16-e2317f9d22b6 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,091 mnist_classifier_MNISTClassifier ywrat4p0 0615f6ef-99ed-4e05-9027-25da894501da -- POST / 200 406.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,092 mnist_classifier_MNISTClassifier ywrat4p0 1e3b680a-5259-4b6a-b343-ee646e303d45 -- POST / 200 406.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,092 mnist_classifier_MNISTClassifier ywrat4p0 30c657b8-1d7f-4bf5-b27b-3613d9a5b825 -- POST / 200 405.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,092 mnist_classifier_MNISTClassifier ywrat4p0 a0514cac-b052-49f8-94c7-4ce3e450d776 -- POST / 200 402.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,092 mnist_classifier_MNISTClassifier ywrat4p0 812825a1-c9ee-487c-9139-dc1f5e37e4ae -- POST / 200 402.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,094 mnist_classifier_MNISTClassifier ywrat4p0 bbcc8080-5ec2-4b8c-90f7-3ee51eb325ab -- POST / 200 403.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,095 mnist_classifier_MNISTClassifier ywrat4p0 e6317152-9b2a-45b3-9e7d-84bd847b6d30 -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,095 mnist_classifier_MNISTClassifier ywrat4p0 450e1823-1557-4c93-9e20-1e6ddcf98015 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,096 mnist_classifier_MNISTClassifier ywrat4p0 7131c906-3fd2-4f46-b828-9d6d250eef2d -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,097 mnist_classifier_MNISTClassifier ywrat4p0 9d0750ca-4f03-4a75-8eba-1dd359d06214 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,097 mnist_classifier_MNISTClassifier ywrat4p0 e3db32bc-d02e-4e48-9282-589e3b407077 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,098 mnist_classifier_MNISTClassifier ywrat4p0 8fac40ff-7dd0-4a8d-babc-3bc701b0faf6 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,098 mnist_classifier_MNISTClassifier ywrat4p0 04e05789-f0bd-4e99-8221-393dc6fae7a2 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,098 mnist_classifier_MNISTClassifier ywrat4p0 ec6bfdef-45df-45a3-8442-8fddd8fd6b63 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,099 mnist_classifier_MNISTClassifier ywrat4p0 a12a9c8a-6ff5-47af-8c95-c3804cec179b -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,099 mnist_classifier_MNISTClassifier ywrat4p0 0d3acb14-8d3b-4420-9784-ed8a525fbc3c -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,099 mnist_classifier_MNISTClassifier ywrat4p0 af1d7976-6a6a-4595-8f0f-831e866f6b3a -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,100 mnist_classifier_MNISTClassifier ywrat4p0 f06c153c-1ac2-40bb-ad23-9a8fc10d74f0 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,100 mnist_classifier_MNISTClassifier ywrat4p0 29925bb7-c802-449a-83a9-5affc823e331 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,100 mnist_classifier_MNISTClassifier ywrat4p0 f290b2eb-893b-4a66-86f6-774635b24e24 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,101 mnist_classifier_MNISTClassifier ywrat4p0 8738353f-dafc-455d-a682-ca85f0bd946a -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,101 mnist_classifier_MNISTClassifier ywrat4p0 dd88186f-1ed7-4561-8ded-22323d04d264 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,101 mnist_classifier_MNISTClassifier ywrat4p0 c77967ac-3495-4545-b5fb-f3e8b8e94382 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,102 mnist_classifier_MNISTClassifier ywrat4p0 32a76860-1505-44b4-86f6-3205a67aa597 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,102 mnist_classifier_MNISTClassifier ywrat4p0 20ba32ed-9f98-4799-bf27-c32e647ed61c -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,102 mnist_classifier_MNISTClassifier ywrat4p0 58e41495-014f-4a9f-9474-7fd9ae7503a2 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,103 mnist_classifier_MNISTClassifier ywrat4p0 29e2c93b-69ce-4b7a-848f-581d8ad64648 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,103 mnist_classifier_MNISTClassifier ywrat4p0 8a00aab7-8176-4bba-985f-ff00289a8776 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,105 mnist_classifier_MNISTClassifier ywrat4p0 28dfb565-672e-436d-af07-a2a4619bab40 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,108 mnist_classifier_MNISTClassifier ywrat4p0 76fc88bd-48a6-4f91-9974-0928c2a8a0d5 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,109 mnist_classifier_MNISTClassifier ywrat4p0 828b9c56-3a34-48a7-b07d-b710bce0baf1 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,110 mnist_classifier_MNISTClassifier ywrat4p0 83b699a9-8f34-4165-8656-8d9988c6dbd5 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,140 mnist_classifier_MNISTClassifier ywrat4p0 a7f92e5a-d7cd-40cc-9f6d-4ffc2132c5ec -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,154 mnist_classifier_MNISTClassifier ywrat4p0 df4afcc9-8097-425b-bc1c-98b9df94673b -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,156 mnist_classifier_MNISTClassifier ywrat4p0 11be9342-cf56-4f55-964d-b308c395ba6e -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,158 mnist_classifier_MNISTClassifier ywrat4p0 dc07d6b4-ed24-488f-a6b3-d4431c78948d -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,158 mnist_classifier_MNISTClassifier ywrat4p0 a7b3e997-f9fd-42fb-a2f8-cc845281ded2 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,158 mnist_classifier_MNISTClassifier ywrat4p0 e67fcebb-83d2-4fff-ae16-c1ce0538ae58 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,159 mnist_classifier_MNISTClassifier ywrat4p0 a2739af3-b52e-45de-9ae3-49f1a0061d74 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,159 mnist_classifier_MNISTClassifier ywrat4p0 46f94184-8f4a-4374-9068-26e0b90dec75 -- POST / 200 205.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,159 mnist_classifier_MNISTClassifier ywrat4p0 3fa2393c-77fa-4c30-8088-c2d37329844c -- POST / 200 196.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,160 mnist_classifier_MNISTClassifier ywrat4p0 de563628-38f8-47bc-b3be-662b38826e19 -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,160 mnist_classifier_MNISTClassifier ywrat4p0 29b3d0ae-7e3f-46f5-92f3-132622bc313c -- POST / 200 193.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,160 mnist_classifier_MNISTClassifier ywrat4p0 3ca924b6-a0b9-4065-860c-412e81ae2288 -- POST / 200 192.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,160 mnist_classifier_MNISTClassifier ywrat4p0 b3c3b339-a718-45a6-8187-cc277fe6a450 -- POST / 200 192.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,161 mnist_classifier_MNISTClassifier ywrat4p0 a145dc00-b7a7-4e05-a066-1cf7b1e379fa -- POST / 200 191.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,161 mnist_classifier_MNISTClassifier ywrat4p0 bab02373-a1f8-4c47-a3c8-ee63c3461448 -- POST / 200 191.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,161 mnist_classifier_MNISTClassifier ywrat4p0 17b3730b-2553-4c7d-a08d-7a1ed3c7f4db -- POST / 200 190.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,161 mnist_classifier_MNISTClassifier ywrat4p0 bf96bae1-41b0-420b-b035-09436ac616ca -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,162 mnist_classifier_MNISTClassifier ywrat4p0 4f808dd2-0686-4593-9243-2388bb1ce35a -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,162 mnist_classifier_MNISTClassifier ywrat4p0 b471b563-88c3-429b-85d7-3b3a7e4d9936 -- POST / 200 185.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,162 mnist_classifier_MNISTClassifier ywrat4p0 e6b3dd80-a91f-4ff0-8b4a-e045b51839d3 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,162 mnist_classifier_MNISTClassifier ywrat4p0 39f64500-f39f-4c59-b2fd-fe6ca58e0b4d -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,162 mnist_classifier_MNISTClassifier ywrat4p0 a9aa9197-e8e5-4c8b-bcaa-e416d60ed466 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 f0911cb2-5374-4802-9ed8-643d25b92a02 -- POST / 200 179.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 510ddd47-2ebf-4588-967d-92ed82ead9a0 -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 6ebd6c81-05ef-4fe1-9f3a-86db459e20f1 -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 eb86af96-c737-4717-8b76-22d97209b0a7 -- POST / 200 178.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 1d4ffbe3-eb9f-4dfb-970a-77c9c1e7d936 -- POST / 200 178.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,163 mnist_classifier_MNISTClassifier ywrat4p0 ff772ccc-5cad-43f9-bfd1-a832831a6999 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,164 mnist_classifier_MNISTClassifier ywrat4p0 4205f53f-7d67-4578-bd59-f0a0bb7fb543 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,164 mnist_classifier_MNISTClassifier ywrat4p0 c0d9e29c-a495-4c12-8793-1b93c4e8394a -- POST / 200 175.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,334 mnist_classifier_MNISTClassifier ywrat4p0 c89bd51d-a88f-4c8f-88a2-897b476a996d -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,337 mnist_classifier_MNISTClassifier ywrat4p0 d3c8c5bb-5272-4d51-a73d-80160aa476d7 -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,338 mnist_classifier_MNISTClassifier ywrat4p0 2c93afde-e448-4d61-a7b6-0b9c838881a3 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,338 mnist_classifier_MNISTClassifier ywrat4p0 07decdb4-12ce-4951-8ed4-5402792350fe -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,340 mnist_classifier_MNISTClassifier ywrat4p0 37f21d9b-3f12-480f-9261-8080d2e7935a -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,341 mnist_classifier_MNISTClassifier ywrat4p0 c08d2e10-d30c-44d4-969d-607a68ec82fb -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,345 mnist_classifier_MNISTClassifier ywrat4p0 94c25000-9d00-476d-abe6-88c53b5065de -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,346 mnist_classifier_MNISTClassifier ywrat4p0 f5a7397f-6060-436d-99b0-2d5cc4d64cc4 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,347 mnist_classifier_MNISTClassifier ywrat4p0 618b46f1-49bd-4d4b-960f-e5292351d2a8 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,348 mnist_classifier_MNISTClassifier ywrat4p0 8439c5e1-3971-4f3f-ab4d-47b595e22d53 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,349 mnist_classifier_MNISTClassifier ywrat4p0 ac0c384d-430e-4d23-b4a8-05d5d95e6d51 -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,350 mnist_classifier_MNISTClassifier ywrat4p0 ceb7fd2b-9ec4-4762-8ef9-14b0c3d44a99 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,352 mnist_classifier_MNISTClassifier ywrat4p0 cbf3c398-90bd-4ab1-a2f7-a0de5abd1a9f -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,503 mnist_classifier_MNISTClassifier ywrat4p0 3073f18c-2924-4a55-b6e1-24d18d37eb2d -- POST / 200 409.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,504 mnist_classifier_MNISTClassifier ywrat4p0 c8ac4190-ab4d-41f3-b1ea-c014528ebd10 -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,504 mnist_classifier_MNISTClassifier ywrat4p0 f6628fab-d00b-45d2-afdf-655558416569 -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,505 mnist_classifier_MNISTClassifier ywrat4p0 77ae5e1a-05cd-4c52-a4ac-16de29f8f351 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,506 mnist_classifier_MNISTClassifier ywrat4p0 51f30df0-067a-4dfb-8927-3c5b870e8a37 -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,507 mnist_classifier_MNISTClassifier ywrat4p0 9110f21f-8f55-4f8c-9736-5a10b1f42d83 -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,508 mnist_classifier_MNISTClassifier ywrat4p0 22cef450-eac1-491a-83ec-9a48dfde4b7d -- POST / 200 386.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,508 mnist_classifier_MNISTClassifier ywrat4p0 f75ca3da-8110-4671-b27f-deba076850c6 -- POST / 200 381.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,508 mnist_classifier_MNISTClassifier ywrat4p0 08ec5fb6-5c10-440f-9053-28233ae0c2fe -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,508 mnist_classifier_MNISTClassifier ywrat4p0 0fd76cb0-e59b-43ff-a79e-bdd806b64458 -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,509 mnist_classifier_MNISTClassifier ywrat4p0 50425657-320c-4f83-aba5-c3913d31afd5 -- POST / 200 339.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,509 mnist_classifier_MNISTClassifier ywrat4p0 eae48b9c-22b4-4e4f-85a6-bac3e726f9dc -- POST / 200 339.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,509 mnist_classifier_MNISTClassifier ywrat4p0 ef3cdd68-25fc-460b-ab1a-6c2ec2ac7f0a -- POST / 200 339.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,509 mnist_classifier_MNISTClassifier ywrat4p0 846950e9-a1a2-48c5-b9f7-6d6afa12960d -- POST / 200 339.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,510 mnist_classifier_MNISTClassifier ywrat4p0 5bcb0bba-adda-4448-901d-c0a218307a0d -- POST / 200 337.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,510 mnist_classifier_MNISTClassifier ywrat4p0 9606cf38-7f2e-4372-857b-00de32a33520 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,510 mnist_classifier_MNISTClassifier ywrat4p0 51ca4370-7d3c-4008-9ad9-20415547c806 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,512 mnist_classifier_MNISTClassifier ywrat4p0 688b1b37-a2d4-48e9-aa13-074d46e9c5c6 -- POST / 200 309.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,512 mnist_classifier_MNISTClassifier ywrat4p0 f6abc4d3-b5a2-4b91-8a37-1897858a97b9 -- POST / 200 308.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,512 mnist_classifier_MNISTClassifier ywrat4p0 7d4c38ae-6a1a-446a-b770-2b929c587195 -- POST / 200 308.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,513 mnist_classifier_MNISTClassifier ywrat4p0 29f1c790-bfa6-49b8-816d-b980ff85348d -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,513 mnist_classifier_MNISTClassifier ywrat4p0 2c755e28-14e8-49bf-ace3-e0d2e0726732 -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,513 mnist_classifier_MNISTClassifier ywrat4p0 07eacd6f-76a1-4856-8f26-b701a4d9b21c -- POST / 200 307.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,514 mnist_classifier_MNISTClassifier ywrat4p0 3c603572-8e62-4bfa-ac02-35c315e82d49 -- POST / 200 307.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,514 mnist_classifier_MNISTClassifier ywrat4p0 7a335ff3-4087-492c-b719-1b0eeb5a46c0 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,514 mnist_classifier_MNISTClassifier ywrat4p0 59125cd2-2e5d-4d7f-b283-0029eb7f0121 -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,515 mnist_classifier_MNISTClassifier ywrat4p0 4c03beab-1a89-4f57-a168-d93d341dcf59 -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,515 mnist_classifier_MNISTClassifier ywrat4p0 0d448a67-742b-4e42-9c6a-94c45e335dc9 -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,515 mnist_classifier_MNISTClassifier ywrat4p0 c2bdd459-a233-42cd-9b6e-cbdfe24ceb67 -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,516 mnist_classifier_MNISTClassifier ywrat4p0 5c609e12-90e5-4bf5-a462-c536c95b1366 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,516 mnist_classifier_MNISTClassifier ywrat4p0 cc3b4db2-5590-4161-8d10-c3246ffd8057 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,517 mnist_classifier_MNISTClassifier ywrat4p0 68ef933e-043a-4175-9aef-dd72fd043244 -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,518 mnist_classifier_MNISTClassifier ywrat4p0 6212552f-9f86-4928-b6d5-310d47442d08 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,518 mnist_classifier_MNISTClassifier ywrat4p0 79f584cd-8a24-4171-a638-05746820e2ca -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,518 mnist_classifier_MNISTClassifier ywrat4p0 9d18ef72-3b24-44e3-af61-285784bc5047 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,520 mnist_classifier_MNISTClassifier ywrat4p0 19bf06e4-627a-4b60-862f-68d1d7287c9f -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,522 mnist_classifier_MNISTClassifier ywrat4p0 54577947-b59a-4480-8b25-1094a0d907c7 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,523 mnist_classifier_MNISTClassifier ywrat4p0 c576c063-c108-44a8-afe2-f3e1ee834ec5 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,523 mnist_classifier_MNISTClassifier ywrat4p0 77d6a160-7a17-4ca5-9ecf-99ed81c0fb39 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,524 mnist_classifier_MNISTClassifier ywrat4p0 4826f01a-f72a-443f-acdc-bba6a522f478 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,525 mnist_classifier_MNISTClassifier ywrat4p0 e5701b59-f652-4af5-bf47-fb0340b7fab5 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,525 mnist_classifier_MNISTClassifier ywrat4p0 82f733e9-76b7-4f2e-8324-5c72dfe83ef2 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,526 mnist_classifier_MNISTClassifier ywrat4p0 4656b86e-81c2-4a3d-b2e5-329be0a12447 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,526 mnist_classifier_MNISTClassifier ywrat4p0 cd52dd49-05a7-4e8a-9fb5-1f63f181236c -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,526 mnist_classifier_MNISTClassifier ywrat4p0 25120ea8-fc84-4482-b148-03cc05de44e7 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,527 mnist_classifier_MNISTClassifier ywrat4p0 1e111538-7f0d-4b57-9665-dad4da188918 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,528 mnist_classifier_MNISTClassifier ywrat4p0 2d7e3ca8-615f-4a8b-8464-1a053c35e3ee -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,528 mnist_classifier_MNISTClassifier ywrat4p0 02d7522d-64bb-49d0-94e4-3e150826d6f7 -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,529 mnist_classifier_MNISTClassifier ywrat4p0 9b7672ad-7c4b-4d20-b924-04ec2c2a9d4c -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,529 mnist_classifier_MNISTClassifier ywrat4p0 237d81db-4af9-41ca-9c67-ad91078abbf6 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,530 mnist_classifier_MNISTClassifier ywrat4p0 5209a5a7-5680-44f0-8408-1f5a32a0f9d9 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,533 mnist_classifier_MNISTClassifier ywrat4p0 05da0ea9-de76-44cb-93ce-d14aed82f490 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,559 mnist_classifier_MNISTClassifier ywrat4p0 a8a2af72-44a2-4e5e-a453-c10ffdb42cb4 -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,559 mnist_classifier_MNISTClassifier ywrat4p0 c45b3ec4-72a8-416a-9e04-a281661e27a4 -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,559 mnist_classifier_MNISTClassifier ywrat4p0 52b1fdc8-fd84-4cb3-b466-395b812ac9cb -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,560 mnist_classifier_MNISTClassifier ywrat4p0 850a5f69-8c0d-4135-a391-def835cae9bc -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,560 mnist_classifier_MNISTClassifier ywrat4p0 c1ab3163-9503-4bc2-aa36-1b9368d8b589 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 f1663d28-f197-48cc-a425-77a7e9978eff -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 a2fb83aa-d175-405f-9cde-3747a8bf2c8c -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 614c3527-d77b-4ce1-8805-681dde082129 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 044c1f35-dece-428e-9176-910ef334cfae -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 335e53d1-b867-404d-a3da-bc8d314bab94 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,561 mnist_classifier_MNISTClassifier ywrat4p0 44ed9b50-eed3-41ee-9405-5c85f1c3d2df -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,562 mnist_classifier_MNISTClassifier ywrat4p0 153ff886-57ce-499b-bd89-efd6b115806d -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,562 mnist_classifier_MNISTClassifier ywrat4p0 a61c0278-59b6-45f5-a06c-3db3b5949e48 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,563 mnist_classifier_MNISTClassifier ywrat4p0 0c295402-a23c-4664-b31b-ece70e3a929d -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,563 mnist_classifier_MNISTClassifier ywrat4p0 847026ae-7c3f-44d5-8924-516b2d1811eb -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,564 mnist_classifier_MNISTClassifier ywrat4p0 009d6e02-1b4e-46f2-94e0-42044dde4d05 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,564 mnist_classifier_MNISTClassifier ywrat4p0 48cb63f0-e7da-475a-b663-fd4d940736e1 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,569 mnist_classifier_MNISTClassifier ywrat4p0 034bc993-d69f-435f-8590-1ed8de7ad9ef -- POST / 200 292.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,569 mnist_classifier_MNISTClassifier ywrat4p0 c216f41a-fb94-406b-a15b-1b03ba7e5a66 -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,570 mnist_classifier_MNISTClassifier ywrat4p0 9668a816-2176-4c05-83a6-c5504ca9012c -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,570 mnist_classifier_MNISTClassifier ywrat4p0 a3d3b577-0e8f-459c-a372-8d7d9dc28122 -- POST / 200 291.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,570 mnist_classifier_MNISTClassifier ywrat4p0 5d02a608-a52d-4cb6-96e6-c9a30c6709c5 -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,571 mnist_classifier_MNISTClassifier ywrat4p0 212aa6c4-4515-4777-a288-eb910fc43c3f -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,571 mnist_classifier_MNISTClassifier ywrat4p0 f5f4bf22-48e5-42f7-9197-8da5ad411b41 -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,572 mnist_classifier_MNISTClassifier ywrat4p0 86a03fd4-b260-4bd3-b8f8-9e6212d20133 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,572 mnist_classifier_MNISTClassifier ywrat4p0 6416d63d-0c06-40a1-a2da-54e7aad437da -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,573 mnist_classifier_MNISTClassifier ywrat4p0 2be4e116-3a32-4e04-ac65-078e5c9b890b -- POST / 200 290.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,573 mnist_classifier_MNISTClassifier ywrat4p0 ed9a55ec-0603-4baa-ac8a-91613896e82f -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,573 mnist_classifier_MNISTClassifier ywrat4p0 44e6257f-4f9f-4dc0-b1aa-2c77ea0b4dad -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,574 mnist_classifier_MNISTClassifier ywrat4p0 09ba029c-0e26-442d-995b-85c669187946 -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,574 mnist_classifier_MNISTClassifier ywrat4p0 16a3c388-8e55-46d8-8709-51f4165a1396 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,574 mnist_classifier_MNISTClassifier ywrat4p0 e3a6db44-f5ec-42d1-b57f-f95d1061e8db -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,575 mnist_classifier_MNISTClassifier ywrat4p0 1b8ae5bc-bd84-4f45-8642-e0b18b7cd807 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,575 mnist_classifier_MNISTClassifier ywrat4p0 9554d0ce-4cb4-416e-adcd-bcd0d3c8bf01 -- POST / 200 272.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,575 mnist_classifier_MNISTClassifier ywrat4p0 ea722983-57d7-40eb-97d6-1294b8aacd0d -- POST / 200 272.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,575 mnist_classifier_MNISTClassifier ywrat4p0 8f51de29-19e6-4d1d-95fa-eebb45e43319 -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,576 mnist_classifier_MNISTClassifier ywrat4p0 f659eba1-4c8d-41b7-b199-6a8d90631f21 -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,578 mnist_classifier_MNISTClassifier ywrat4p0 111a4981-5873-4a6a-8eeb-1d3215040e3f -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,580 mnist_classifier_MNISTClassifier ywrat4p0 85f6903f-f42a-44df-840e-08a2af410d2e -- POST / 200 218.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,591 mnist_classifier_MNISTClassifier ywrat4p0 57887b87-8fde-48c7-ab2f-fb8984661788 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,592 mnist_classifier_MNISTClassifier ywrat4p0 30653e44-58fd-4422-9d76-6012a6023f15 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,594 mnist_classifier_MNISTClassifier ywrat4p0 93cab322-896a-4b8d-a6ed-3858171d3611 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,599 mnist_classifier_MNISTClassifier ywrat4p0 5af7688e-b334-4a95-8c4a-e7a649a74e8f -- POST / 200 208.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,599 mnist_classifier_MNISTClassifier ywrat4p0 d4a5dc98-53fc-4856-a26e-0ec3303987c1 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,599 mnist_classifier_MNISTClassifier ywrat4p0 72192fa7-81ca-4c02-ad37-3e12825cc9d5 -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,600 mnist_classifier_MNISTClassifier ywrat4p0 20faa719-cfde-43c5-86ef-c5abf24a5b0e -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,600 mnist_classifier_MNISTClassifier ywrat4p0 16a7125f-9851-4d73-b02b-51fb59150fab -- POST / 200 198.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,600 mnist_classifier_MNISTClassifier ywrat4p0 97608529-7b56-4089-b92c-f045657f3279 -- POST / 200 198.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,930 mnist_classifier_MNISTClassifier ywrat4p0 5f9cd135-43d0-4751-9649-c396f6d21602 -- POST / 200 397.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,931 mnist_classifier_MNISTClassifier ywrat4p0 2ab3e445-9620-4b68-bf2e-632af0aae493 -- POST / 200 397.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,932 mnist_classifier_MNISTClassifier ywrat4p0 7285878c-3ce5-49e4-bb71-ab636da9d68a -- POST / 200 330.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,932 mnist_classifier_MNISTClassifier ywrat4p0 9b9994d8-e1b6-4761-a79b-42cfa03334bf -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,932 mnist_classifier_MNISTClassifier ywrat4p0 122f41aa-0a00-47db-9eec-0a54dcb988ac -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,932 mnist_classifier_MNISTClassifier ywrat4p0 6b103431-a523-4eed-9672-90400f1d1638 -- POST / 200 321.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:29,933 mnist_classifier_MNISTClassifier ywrat4p0 3c4e5e2f-db2c-4fa0-8832-338f2399042a -- POST / 200 322.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,105 mnist_classifier_MNISTClassifier ywrat4p0 3242041e-3af6-44f2-b949-8538abcae7c8 -- POST / 200 490.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,105 mnist_classifier_MNISTClassifier ywrat4p0 4f7e9ae3-fce2-45a4-b9e2-74699a2ed6cf -- POST / 200 491.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,106 mnist_classifier_MNISTClassifier ywrat4p0 5c360d34-8fab-49f5-9493-94f789cc376a -- POST / 200 483.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,107 mnist_classifier_MNISTClassifier ywrat4p0 4f1e137c-a914-4624-a742-9f74f45fe5f5 -- POST / 200 491.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,108 mnist_classifier_MNISTClassifier ywrat4p0 a6180de5-e0cd-4760-a54d-94912c7c5952 -- POST / 200 492.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,109 mnist_classifier_MNISTClassifier ywrat4p0 c725202a-dd99-41a6-8283-bd7035bfa4b0 -- POST / 200 493.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,110 mnist_classifier_MNISTClassifier ywrat4p0 cf6362f0-9ffc-4444-8dd7-daab5fcf9a86 -- POST / 200 493.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,110 mnist_classifier_MNISTClassifier ywrat4p0 a36e1fd0-c627-4f2c-88dc-20d78e3376e3 -- POST / 200 492.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,111 mnist_classifier_MNISTClassifier ywrat4p0 a3daaea3-55c2-4047-9986-11babdf5e597 -- POST / 200 491.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,112 mnist_classifier_MNISTClassifier ywrat4p0 9e9a6fd0-8318-4613-a07c-76f367492859 -- POST / 200 491.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,112 mnist_classifier_MNISTClassifier ywrat4p0 2d0d3e04-8e06-4578-8ba4-f065bb5d4f60 -- POST / 200 489.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,112 mnist_classifier_MNISTClassifier ywrat4p0 64a17b81-9dae-434b-b5ee-2e31c4d18704 -- POST / 200 487.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,113 mnist_classifier_MNISTClassifier ywrat4p0 6bd08803-4a8e-4155-9a83-90cc7b348242 -- POST / 200 487.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,113 mnist_classifier_MNISTClassifier ywrat4p0 856e9ee2-cf1f-4471-8895-339db2f3f575 -- POST / 200 487.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,114 mnist_classifier_MNISTClassifier ywrat4p0 015dff05-fa6c-4ebb-b0c1-e0630a5ba386 -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,114 mnist_classifier_MNISTClassifier ywrat4p0 0bfcaaf5-a58f-40e1-a9e8-5bdce847c57e -- POST / 200 485.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,115 mnist_classifier_MNISTClassifier ywrat4p0 6f30614d-7515-4917-a458-ec78edd08ed6 -- POST / 200 486.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,116 mnist_classifier_MNISTClassifier ywrat4p0 879b8e42-508e-4ab8-bde5-0634956e75f3 -- POST / 200 486.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,116 mnist_classifier_MNISTClassifier ywrat4p0 5263cc4b-ccf5-47a7-aa78-cbb82a363b5c -- POST / 200 484.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,117 mnist_classifier_MNISTClassifier ywrat4p0 e441aa33-b3d1-4cc6-9b79-5d3c9d6861f2 -- POST / 200 484.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,117 mnist_classifier_MNISTClassifier ywrat4p0 205665fa-369b-45ca-9e8e-1a4a4950c0e2 -- POST / 200 481.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,117 mnist_classifier_MNISTClassifier ywrat4p0 0af7ccf7-e7ac-405d-bfa7-a2bd769eaec7 -- POST / 200 483.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,118 mnist_classifier_MNISTClassifier ywrat4p0 39d34234-bbab-4f59-8079-cf3b56dc9143 -- POST / 200 481.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,119 mnist_classifier_MNISTClassifier ywrat4p0 ec532dcf-c2c9-4940-9754-fd1abe9fa74d -- POST / 200 481.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,119 mnist_classifier_MNISTClassifier ywrat4p0 0f5cbd5a-33eb-4390-83ee-654117ef0778 -- POST / 200 481.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,120 mnist_classifier_MNISTClassifier ywrat4p0 3863f040-39fa-430e-a1b9-0fcfba488b36 -- POST / 200 482.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,121 mnist_classifier_MNISTClassifier ywrat4p0 d90b0c98-7c90-41e7-b6f1-0a9756560586 -- POST / 200 481.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,121 mnist_classifier_MNISTClassifier ywrat4p0 bacbd3ee-2a1c-469e-857e-0b3b4b7f0e70 -- POST / 200 476.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,121 mnist_classifier_MNISTClassifier ywrat4p0 d7496224-3bc1-47f7-9abb-91f7897a5276 -- POST / 200 482.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,122 mnist_classifier_MNISTClassifier ywrat4p0 512d2402-ac70-409f-a588-4d0fea3489bc -- POST / 200 482.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,122 mnist_classifier_MNISTClassifier ywrat4p0 877c2929-6cc8-42df-9003-24887ed76aa7 -- POST / 200 479.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,124 mnist_classifier_MNISTClassifier ywrat4p0 d8e5cbb7-2071-41cf-9e2a-d2d2d39c5fb3 -- POST / 200 478.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,124 mnist_classifier_MNISTClassifier ywrat4p0 d1d93183-cdfd-4e03-8817-9cac4da74a79 -- POST / 200 481.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,125 mnist_classifier_MNISTClassifier ywrat4p0 197b8374-6eac-49aa-9683-f2bf7cbc84d8 -- POST / 200 481.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,125 mnist_classifier_MNISTClassifier ywrat4p0 4c607ce1-eaa6-4e4f-8b41-dbee28746eb7 -- POST / 200 477.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,125 mnist_classifier_MNISTClassifier ywrat4p0 c895d6d0-5162-4bf1-95b0-fb2e28e2bcd4 -- POST / 200 477.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,128 mnist_classifier_MNISTClassifier ywrat4p0 1a5e0906-3929-4039-b311-7539793211d0 -- POST / 200 477.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,128 mnist_classifier_MNISTClassifier ywrat4p0 aa67f3a1-d87a-45c5-8179-df653d5334d0 -- POST / 200 477.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,128 mnist_classifier_MNISTClassifier ywrat4p0 5ba6c581-01c9-4319-9481-6a9a2fbf85c4 -- POST / 200 476.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,129 mnist_classifier_MNISTClassifier ywrat4p0 35ad3207-cb1b-4f0b-876a-d533621035ed -- POST / 200 476.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,130 mnist_classifier_MNISTClassifier ywrat4p0 daa6123a-6053-448b-95b9-105b0a8afaf8 -- POST / 200 477.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,131 mnist_classifier_MNISTClassifier ywrat4p0 a2c2f275-31a7-4fec-9657-7d82453139d5 -- POST / 200 478.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,133 mnist_classifier_MNISTClassifier ywrat4p0 08f0d5c4-6d4f-4225-b7d7-c8b1d8edb6f9 -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,138 mnist_classifier_MNISTClassifier ywrat4p0 e3fd6aee-3347-4a24-a21f-113b6eda351e -- POST / 200 485.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,139 mnist_classifier_MNISTClassifier ywrat4p0 5739a41b-625d-4edc-91cf-a77dbe873829 -- POST / 200 484.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,140 mnist_classifier_MNISTClassifier ywrat4p0 e34541f8-6a13-4f81-acd6-4009e1f3bdef -- POST / 200 486.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,140 mnist_classifier_MNISTClassifier ywrat4p0 31ae837e-e8dc-4306-b03e-51564d26a503 -- POST / 200 486.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,140 mnist_classifier_MNISTClassifier ywrat4p0 56942afb-481f-4fc4-a154-aeb67e749632 -- POST / 200 484.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,140 mnist_classifier_MNISTClassifier ywrat4p0 dbfd535d-df5a-4164-950a-426fcf6419de -- POST / 200 484.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,141 mnist_classifier_MNISTClassifier ywrat4p0 b73fdab3-ea29-490c-9ed4-879a6337e2d1 -- POST / 200 455.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,141 mnist_classifier_MNISTClassifier ywrat4p0 5d123ca4-4359-48f7-b01c-e99f8cf243b5 -- POST / 200 463.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,141 mnist_classifier_MNISTClassifier ywrat4p0 95edfd62-6bee-45c7-8202-2fac1bcf5835 -- POST / 200 454.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,145 mnist_classifier_MNISTClassifier ywrat4p0 3c2e57ee-c641-490e-9c85-0bff03ed5f8f -- POST / 200 466.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,145 mnist_classifier_MNISTClassifier ywrat4p0 fd7112f8-01ad-4185-a7f5-ba9ef1179ce0 -- POST / 200 466.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,145 mnist_classifier_MNISTClassifier ywrat4p0 5fb22842-b275-4de0-8d3e-25e3a35b148f -- POST / 200 460.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,146 mnist_classifier_MNISTClassifier ywrat4p0 dc9801e0-a4bc-4afb-98b1-a0af413fb4a1 -- POST / 200 449.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,149 mnist_classifier_MNISTClassifier ywrat4p0 a6fa0002-049b-4d6b-93fe-734f4cfe68e0 -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,149 mnist_classifier_MNISTClassifier ywrat4p0 76ee5f4b-9823-4bcd-a5ff-50fe6dc3f765 -- POST / 200 447.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,150 mnist_classifier_MNISTClassifier ywrat4p0 ccc46b45-9315-4f28-88cc-3249497d5010 -- POST / 200 446.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,150 mnist_classifier_MNISTClassifier ywrat4p0 41efdf98-e61f-44a9-86bb-4fda23bf4db6 -- POST / 200 444.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,150 mnist_classifier_MNISTClassifier ywrat4p0 514af969-ee85-47c8-9464-93e923b0cd49 -- POST / 200 444.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,152 mnist_classifier_MNISTClassifier ywrat4p0 deae1212-07fe-46fd-8756-5c87efb682d8 -- POST / 200 445.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,154 mnist_classifier_MNISTClassifier ywrat4p0 96da74ec-71bc-438e-be17-db9ce82813bb -- POST / 200 292.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,154 mnist_classifier_MNISTClassifier ywrat4p0 97fffe80-6fa2-4297-9449-b07c2f19f768 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,155 mnist_classifier_MNISTClassifier ywrat4p0 708bd734-a016-49d9-a3eb-c041e7f7cfb9 -- POST / 200 289.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,156 mnist_classifier_MNISTClassifier ywrat4p0 087a69d8-5b24-4d65-b74a-dbfe79a87178 -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,157 mnist_classifier_MNISTClassifier ywrat4p0 1567bf49-8352-4a51-935c-18dd0af139e6 -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,157 mnist_classifier_MNISTClassifier ywrat4p0 9e179928-9095-4d34-83eb-608ff89e44a4 -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,160 mnist_classifier_MNISTClassifier ywrat4p0 7b03a333-f8a0-4129-bb5a-5c429b8a9f56 -- POST / 200 289.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,161 mnist_classifier_MNISTClassifier ywrat4p0 04721dac-6793-4065-a3be-971e1be88c5e -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,162 mnist_classifier_MNISTClassifier ywrat4p0 835515b2-bd6c-4afe-96b4-082d4708302b -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,163 mnist_classifier_MNISTClassifier ywrat4p0 74632402-4bb2-4361-b154-b2b23726ab15 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,163 mnist_classifier_MNISTClassifier ywrat4p0 8d41b5f8-f34c-421f-b756-c04a65d576df -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,167 mnist_classifier_MNISTClassifier ywrat4p0 2f088510-0656-4787-92b6-502e8de1c0ff -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,168 mnist_classifier_MNISTClassifier ywrat4p0 a544f2c5-cb7f-4d93-add8-c16b0a6c0196 -- POST / 200 294.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,170 mnist_classifier_MNISTClassifier ywrat4p0 551d7159-2559-4176-a585-cc4ef89ea012 -- POST / 200 294.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,170 mnist_classifier_MNISTClassifier ywrat4p0 288068d0-7399-4c64-8126-fc6c0856b6ba -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,171 mnist_classifier_MNISTClassifier ywrat4p0 e7df96b1-51dc-405b-ac05-6d498cd66166 -- POST / 200 293.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,172 mnist_classifier_MNISTClassifier ywrat4p0 7eade41f-2fa1-4a64-b273-1e5dd9579966 -- POST / 200 294.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,172 mnist_classifier_MNISTClassifier ywrat4p0 310cc59d-84dc-46ff-b701-5fdda150d434 -- POST / 200 294.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,173 mnist_classifier_MNISTClassifier ywrat4p0 bfcb4dbd-a7d6-407b-b5ba-bcda925a9bb7 -- POST / 200 295.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,175 mnist_classifier_MNISTClassifier ywrat4p0 73ab4381-7a22-4fb4-ba1d-1d059cfe32f8 -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,176 mnist_classifier_MNISTClassifier ywrat4p0 491910cc-7b61-49f4-a88a-797b84b5d4ad -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,177 mnist_classifier_MNISTClassifier ywrat4p0 50111a55-a90d-4c0c-ae95-521edc85e4aa -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,177 mnist_classifier_MNISTClassifier ywrat4p0 e8a4dbc7-36f7-4191-86c5-705479f3d799 -- POST / 200 297.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,178 mnist_classifier_MNISTClassifier ywrat4p0 eba65274-4fba-4931-bb06-c216b1208e7a -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,179 mnist_classifier_MNISTClassifier ywrat4p0 a346b98a-6f81-4e00-81fe-ea1637693d3e -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,179 mnist_classifier_MNISTClassifier ywrat4p0 14b2e1d6-cbd7-4555-8fae-f74e49237e18 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,180 mnist_classifier_MNISTClassifier ywrat4p0 e5f3f33c-24ca-4ed4-99fa-2580a4126b02 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,180 mnist_classifier_MNISTClassifier ywrat4p0 1612c17a-0029-4265-8aa0-09b03c766e84 -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,181 mnist_classifier_MNISTClassifier ywrat4p0 c06a8b98-943f-40a2-9715-79644afa8bdd -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,182 mnist_classifier_MNISTClassifier ywrat4p0 e68dc011-8d10-4e50-b923-17e84497c50a -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,183 mnist_classifier_MNISTClassifier ywrat4p0 6e878ab0-155b-4718-b5da-575c45f6ad86 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,193 mnist_classifier_MNISTClassifier ywrat4p0 41b9174a-60fb-4d00-8964-f81d30813cc6 -- POST / 200 485.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,193 mnist_classifier_MNISTClassifier ywrat4p0 76b3b523-37b0-43c6-84a8-f39c83f73142 -- POST / 200 484.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,194 mnist_classifier_MNISTClassifier ywrat4p0 7db7b2ac-0ad3-4e3c-8388-b8f6affab5ac -- POST / 200 485.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,194 mnist_classifier_MNISTClassifier ywrat4p0 64ebfb7f-1307-432f-b933-970b3c1a4d4f -- POST / 200 485.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,195 mnist_classifier_MNISTClassifier ywrat4p0 7085ce2e-74ab-457c-9270-f11697c6d5b5 -- POST / 200 480.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,195 mnist_classifier_MNISTClassifier ywrat4p0 fb0602a7-6531-411d-916c-dc09cbaefdbd -- POST / 200 479.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,195 mnist_classifier_MNISTClassifier ywrat4p0 4e78701e-88ec-4ba6-aef3-9a31381ab146 -- POST / 200 333.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,381 mnist_classifier_MNISTClassifier ywrat4p0 16ebbdaa-4bdc-40dc-ba16-1220626e62c6 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,383 mnist_classifier_MNISTClassifier ywrat4p0 34579589-bf30-4a93-bc17-13f49a77e7c9 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,384 mnist_classifier_MNISTClassifier ywrat4p0 97ce2f66-edf0-4a68-8de2-6fcad124fade -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,386 mnist_classifier_MNISTClassifier ywrat4p0 6f26a5e3-c500-47dd-a627-d0a0c2684552 -- POST / 200 189.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,388 mnist_classifier_MNISTClassifier ywrat4p0 fa9f1d0a-3a97-433d-92de-787c68025ee4 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,394 mnist_classifier_MNISTClassifier ywrat4p0 7593625d-b0f5-452c-b4d3-84e6a6b488fa -- POST / 200 197.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,394 mnist_classifier_MNISTClassifier ywrat4p0 abf2d830-e86d-451b-ae1e-51c1eacd405e -- POST / 200 194.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,400 mnist_classifier_MNISTClassifier ywrat4p0 df938d25-d0b3-45d7-b8f9-49d2ba85b49b -- POST / 200 198.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,401 mnist_classifier_MNISTClassifier ywrat4p0 63b25b4b-1223-451a-bd66-38389e183eef -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,402 mnist_classifier_MNISTClassifier ywrat4p0 ce55b80f-e56e-4302-8d33-ac45b58b9fdf -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,402 mnist_classifier_MNISTClassifier ywrat4p0 aa728424-bf8c-4e99-b65d-5dd98e3a3258 -- POST / 200 198.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,404 mnist_classifier_MNISTClassifier ywrat4p0 8678fefe-1045-45ce-ad9e-73b6c5b648e6 -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,405 mnist_classifier_MNISTClassifier ywrat4p0 b6a55cd8-7de1-464e-9d7f-b5ae1c41c219 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,406 mnist_classifier_MNISTClassifier ywrat4p0 56959d13-8db4-4382-a702-4857a9b23424 -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,406 mnist_classifier_MNISTClassifier ywrat4p0 ea053bbf-7807-4900-bf05-c15f6104e156 -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,408 mnist_classifier_MNISTClassifier ywrat4p0 ac9697cf-87df-42ef-917e-7334ad99cb6f -- POST / 200 199.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,409 mnist_classifier_MNISTClassifier ywrat4p0 183fcd02-371f-4e29-948e-232f21677849 -- POST / 200 200.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,519 mnist_classifier_MNISTClassifier ywrat4p0 d8988c21-8203-4904-9dcd-616edd9dffa6 -- POST / 200 308.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,520 mnist_classifier_MNISTClassifier ywrat4p0 b9727de7-f4c8-409d-98eb-a0c242660fe9 -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,522 mnist_classifier_MNISTClassifier ywrat4p0 7992cd3f-8877-41a7-bb57-f106179cfc26 -- POST / 200 309.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,522 mnist_classifier_MNISTClassifier ywrat4p0 d9d7f26f-b444-41a3-bfad-e0af51e49cdd -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,523 mnist_classifier_MNISTClassifier ywrat4p0 235c7f5b-2f47-4c54-a074-dbc3fd9204fe -- POST / 200 308.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,524 mnist_classifier_MNISTClassifier ywrat4p0 1b15483d-7708-42a1-8f76-756964171b93 -- POST / 200 310.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,525 mnist_classifier_MNISTClassifier ywrat4p0 2a2dfa05-549e-4a42-a4ff-60cd16ad6b49 -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,526 mnist_classifier_MNISTClassifier ywrat4p0 1bb8f311-8a66-422f-8717-7ce4121b7ee2 -- POST / 200 309.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,526 mnist_classifier_MNISTClassifier ywrat4p0 527d8bee-e9d1-4c53-9b70-29c7dcce90a9 -- POST / 200 310.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,527 mnist_classifier_MNISTClassifier ywrat4p0 11c521fb-ba03-4a12-ad44-84c6f7193d2e -- POST / 200 309.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,527 mnist_classifier_MNISTClassifier ywrat4p0 42d9106d-2bf0-4abd-8d35-6a56354547b9 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,528 mnist_classifier_MNISTClassifier ywrat4p0 97a661a0-8213-40d4-acb5-4b532da23789 -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,528 mnist_classifier_MNISTClassifier ywrat4p0 93142012-7948-4e5a-b98a-02ed82b1c5f4 -- POST / 200 297.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,529 mnist_classifier_MNISTClassifier ywrat4p0 7cd04f4d-f8b1-4e89-939b-379a942f4cc3 -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,529 mnist_classifier_MNISTClassifier ywrat4p0 b212152e-0941-4080-ad66-6acc88b9ad28 -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,529 mnist_classifier_MNISTClassifier ywrat4p0 8f8c8fa8-55b3-4c4a-ae83-061051685e0d -- POST / 200 309.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,530 mnist_classifier_MNISTClassifier ywrat4p0 b328463d-6716-4d7e-8e53-aefab1e2c5d9 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,532 mnist_classifier_MNISTClassifier ywrat4p0 115b0144-1bb3-4d6b-a5bd-0a4332f611dd -- POST / 200 308.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,532 mnist_classifier_MNISTClassifier ywrat4p0 2c167c4f-b62e-41d3-9352-5a3c6643bfc1 -- POST / 200 308.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,532 mnist_classifier_MNISTClassifier ywrat4p0 a7ae5ca6-0721-4878-ac81-9bce441f1dec -- POST / 200 307.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,533 mnist_classifier_MNISTClassifier ywrat4p0 71b3ce1f-45cc-491f-87f2-2d9ca80c3ffd -- POST / 200 305.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,534 mnist_classifier_MNISTClassifier ywrat4p0 e508705b-2389-4053-b7eb-50115cfc8d85 -- POST / 200 298.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,534 mnist_classifier_MNISTClassifier ywrat4p0 cbc13869-4818-470e-8356-a0da62cedf10 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,535 mnist_classifier_MNISTClassifier ywrat4p0 d07f355b-07d6-4f17-b6f7-fdff02f93f75 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,535 mnist_classifier_MNISTClassifier ywrat4p0 26e914aa-ea88-44df-91e8-235a75f04958 -- POST / 200 293.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,536 mnist_classifier_MNISTClassifier ywrat4p0 cb0f9fd0-7b06-45d3-b29f-8cb01a2349c6 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,539 mnist_classifier_MNISTClassifier ywrat4p0 8f9b58c4-a102-4e65-b33c-93ae8c165701 -- POST / 200 295.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,541 mnist_classifier_MNISTClassifier ywrat4p0 17ec1524-b4aa-45f3-b413-2f81e5e88c55 -- POST / 200 203.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,542 mnist_classifier_MNISTClassifier ywrat4p0 e0858d52-4729-4137-bdc1-78a7d30c78a8 -- POST / 200 202.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,542 mnist_classifier_MNISTClassifier ywrat4p0 ea13db2b-1a67-4152-8740-ef9f1d4846f4 -- POST / 200 298.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,542 mnist_classifier_MNISTClassifier ywrat4p0 f7f31073-226c-4434-9c79-4cf84321ed1a -- POST / 200 298.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,542 mnist_classifier_MNISTClassifier ywrat4p0 33ce8b4d-0cc6-40b9-acde-ed1e50028b5f -- POST / 200 297.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,543 mnist_classifier_MNISTClassifier ywrat4p0 6d173f66-2937-47b5-be63-0a5df9594029 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,543 mnist_classifier_MNISTClassifier ywrat4p0 385b0982-16db-465d-ac7e-607d277d495f -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,543 mnist_classifier_MNISTClassifier ywrat4p0 844cf8a0-62a1-44ee-81c0-fdc6853a9949 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,544 mnist_classifier_MNISTClassifier ywrat4p0 790d5a5e-de8c-4fd3-afb1-3bbcca3ebe42 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,545 mnist_classifier_MNISTClassifier ywrat4p0 067cc921-767a-4681-bd93-673021d0d9cc -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,545 mnist_classifier_MNISTClassifier ywrat4p0 b7c7e853-1d8a-4f46-b696-c9842d9d47b4 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,547 mnist_classifier_MNISTClassifier ywrat4p0 73e6f14e-823e-45c3-b0fe-bc0457e927db -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,547 mnist_classifier_MNISTClassifier ywrat4p0 f5fae007-4d02-480d-98a1-aef84be8efb0 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,547 mnist_classifier_MNISTClassifier ywrat4p0 cd684e26-5248-484d-bcfe-dda3fc2851d1 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,547 mnist_classifier_MNISTClassifier ywrat4p0 8f8f25a7-3c36-4da8-9704-1b6a9f22a860 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,547 mnist_classifier_MNISTClassifier ywrat4p0 ba49f36c-20bf-418d-b377-d858efd12142 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 662f3b73-5916-48e7-951d-b44c87883185 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 eeb88b96-03f3-4c62-b1e3-930298ad65fb -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 2242238f-8e97-4488-9ba9-479700dc63e2 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 6f4d6420-5241-40f7-82cb-674af778eeb0 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 17adf5f9-2a25-489a-b245-5e0bc1e82fae -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,548 mnist_classifier_MNISTClassifier ywrat4p0 38296c90-8df4-4ece-a7ad-2fff41b906c1 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 67903680-7d3b-46f2-9335-82062c6b96a5 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 45ee8095-94cb-46a8-89f6-daef17991aee -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 2ae451a8-a24b-4f2d-a4a7-49b97bde9520 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 ee19cd49-218f-46b3-9680-ef58e7ca1653 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 40acb83c-bf59-4fbe-a202-fd7156bcb512 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 7c0b7ab5-d6de-4c3c-a43d-f62649974ece -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,549 mnist_classifier_MNISTClassifier ywrat4p0 3760fac6-e21d-4d71-9995-e95697772680 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,551 mnist_classifier_MNISTClassifier ywrat4p0 6f48b0e5-d832-4ed2-a23e-053d4352beca -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,551 mnist_classifier_MNISTClassifier ywrat4p0 a45b5f3a-4975-4d4b-9551-20a5ea6e02f7 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,551 mnist_classifier_MNISTClassifier ywrat4p0 ff9c1818-0c54-4686-acf1-2b2df7832ef2 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,554 mnist_classifier_MNISTClassifier ywrat4p0 78b8b111-f797-4822-804b-50f15564f017 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,554 mnist_classifier_MNISTClassifier ywrat4p0 f6c542bd-fdd7-43f4-838f-ae879db9ca4f -- POST / 200 245.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,555 mnist_classifier_MNISTClassifier ywrat4p0 8e1f3eae-7863-4138-b40c-d7d140c0e310 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,556 mnist_classifier_MNISTClassifier ywrat4p0 450d01d9-f074-45e7-a9a7-a53a5a0d1d11 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,556 mnist_classifier_MNISTClassifier ywrat4p0 c5ec4073-993a-471b-8875-c306d8ce90ed -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,557 mnist_classifier_MNISTClassifier ywrat4p0 eaeee9e3-1401-43bf-ad8e-9dc457b08b7e -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,557 mnist_classifier_MNISTClassifier ywrat4p0 aebacdcc-c05e-4f82-8bc3-7c066649aa64 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,559 mnist_classifier_MNISTClassifier ywrat4p0 bfbf00d9-00ea-432f-804f-c200aee2d384 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,560 mnist_classifier_MNISTClassifier ywrat4p0 f228e130-eec1-4f06-b953-04acf13f24d2 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,561 mnist_classifier_MNISTClassifier ywrat4p0 91b90228-d0d4-4d23-942d-3bf943b0672a -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,561 mnist_classifier_MNISTClassifier ywrat4p0 8c48a99c-22d4-4ed8-a934-4d2532d8076d -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,562 mnist_classifier_MNISTClassifier ywrat4p0 3f52efc9-8133-455e-95d1-6be40c61536b -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,562 mnist_classifier_MNISTClassifier ywrat4p0 e6ff35d6-5806-4ea6-82bc-25f11471d6dd -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,603 mnist_classifier_MNISTClassifier ywrat4p0 56477bd5-89f0-4294-b123-ad455cd0fdac -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,648 mnist_classifier_MNISTClassifier ywrat4p0 3f853a39-9c87-4f9f-9cbc-9245d7976c2e -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,651 mnist_classifier_MNISTClassifier ywrat4p0 66f4048e-1007-48a4-a8e2-5c0774612133 -- POST / 200 308.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,651 mnist_classifier_MNISTClassifier ywrat4p0 6d504665-3ef2-48c6-aaaa-5190684e0591 -- POST / 200 308.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 3757789b-0bf5-47e5-915f-9a53938a6ba8 -- POST / 200 308.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 bcac2701-e09e-4abc-8e27-e348cac64635 -- POST / 200 304.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 601efad2-2ad7-4520-9373-3964f1beb77f -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 97174099-d8f2-464a-aca8-592b2a4a2d04 -- POST / 200 304.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 ff898fdb-58ca-4385-98dc-d98ea820cc32 -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,652 mnist_classifier_MNISTClassifier ywrat4p0 9048b826-e892-495a-832d-009ca02ef516 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,653 mnist_classifier_MNISTClassifier ywrat4p0 c63192af-2010-4064-9375-01085cd1a776 -- POST / 200 301.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,653 mnist_classifier_MNISTClassifier ywrat4p0 486194e7-9cc6-46b9-a1fd-9d40002107e9 -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,653 mnist_classifier_MNISTClassifier ywrat4p0 2183f4a4-8cea-4742-916e-7bfaa51be78e -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,653 mnist_classifier_MNISTClassifier ywrat4p0 8b03d48e-2311-48ed-8e2a-aac60d65b9a0 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,653 mnist_classifier_MNISTClassifier ywrat4p0 44b03b52-131e-4110-b401-df571f37871b -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 24e2e4df-995a-43a2-b9e1-683d717e97ca -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 04e34f8d-3b92-4847-9557-5c595c492d51 -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 b6782343-2c37-42e6-9d57-aeccd6b833ec -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 175e0164-f594-4019-be9d-6b6b84134bd4 -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 b582a14b-0805-4881-b39b-76d79809c112 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,654 mnist_classifier_MNISTClassifier ywrat4p0 0c93b2f0-d056-42bc-aab2-70708124cabb -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,655 mnist_classifier_MNISTClassifier ywrat4p0 6049bfa0-1965-4c49-8f58-549bb2fd54d1 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,655 mnist_classifier_MNISTClassifier ywrat4p0 dfcdb8c6-9c63-473e-b83b-ea915622621d -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,655 mnist_classifier_MNISTClassifier ywrat4p0 567019df-c174-4ab2-a4eb-0bcf34114f60 -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,655 mnist_classifier_MNISTClassifier ywrat4p0 6cf8c508-413c-471b-b4ec-1640864504e7 -- POST / 200 211.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,658 mnist_classifier_MNISTClassifier ywrat4p0 d98cba51-0569-4003-9a39-4694996786c7 -- POST / 200 209.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,662 mnist_classifier_MNISTClassifier ywrat4p0 a6ed7551-1ae2-4dc5-99d2-7251aad25b6e -- POST / 200 207.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,663 mnist_classifier_MNISTClassifier ywrat4p0 ee442e2d-7b79-412c-aab2-a18b716ade86 -- POST / 200 208.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,914 mnist_classifier_MNISTClassifier ywrat4p0 fc313873-3b90-4eeb-83e5-17c0a57e38b3 -- POST / 200 392.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,915 mnist_classifier_MNISTClassifier ywrat4p0 e5846cb5-641c-4f44-836a-832c5db72e6a -- POST / 200 388.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,915 mnist_classifier_MNISTClassifier ywrat4p0 0bdefb0a-f68d-40ae-9d0b-0e4b2debf9d9 -- POST / 200 375.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,916 mnist_classifier_MNISTClassifier ywrat4p0 a831c077-a804-45f3-8a90-19ef99647ab3 -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,916 mnist_classifier_MNISTClassifier ywrat4p0 5de2dd16-a0e8-4f69-8e97-01482581a40f -- POST / 200 348.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,916 mnist_classifier_MNISTClassifier ywrat4p0 1a936c43-d7d6-4396-9c83-6030b42803d7 -- POST / 200 386.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,917 mnist_classifier_MNISTClassifier ywrat4p0 51d3afb4-f0db-4353-8c77-453d3b407706 -- POST / 200 348.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,917 mnist_classifier_MNISTClassifier ywrat4p0 a22fd4ab-4790-4069-89c9-54e42738e43d -- POST / 200 348.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,918 mnist_classifier_MNISTClassifier ywrat4p0 e8fb7255-1b23-488d-8171-2fa7252067c2 -- POST / 200 348.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,921 mnist_classifier_MNISTClassifier ywrat4p0 0644a352-af05-4ec3-ac97-5365c7e5b31a -- POST / 200 350.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,922 mnist_classifier_MNISTClassifier ywrat4p0 647ec453-dcf5-4d51-901e-f9cb78a85f67 -- POST / 200 350.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,923 mnist_classifier_MNISTClassifier ywrat4p0 04256a5b-1cac-414e-8513-98de49a9448f -- POST / 200 349.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:30,999 mnist_classifier_MNISTClassifier ywrat4p0 30308c03-4ec2-416b-a667-b20a2fb51dc3 -- POST / 200 425.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,001 mnist_classifier_MNISTClassifier ywrat4p0 2b8593c6-1f29-4b1c-bcbd-4cdd83788267 -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,001 mnist_classifier_MNISTClassifier ywrat4p0 426d8b6b-4435-4b91-85f6-3c6fb44af82c -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,002 mnist_classifier_MNISTClassifier ywrat4p0 c20a28ce-f41a-46df-a098-21ca23517bf6 -- POST / 200 421.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,003 mnist_classifier_MNISTClassifier ywrat4p0 b33194da-55fa-400c-96b1-4b6d9ab16ebd -- POST / 200 421.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,005 mnist_classifier_MNISTClassifier ywrat4p0 107c44de-f6e0-4a7e-90f2-c81f95d74559 -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,006 mnist_classifier_MNISTClassifier ywrat4p0 e04907a6-0e77-4664-81d2-7194540c0e2d -- POST / 200 423.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,007 mnist_classifier_MNISTClassifier ywrat4p0 f7deb5ec-b1c2-4773-bf2c-f43c3d2797b1 -- POST / 200 423.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,008 mnist_classifier_MNISTClassifier ywrat4p0 edbb1f8f-7588-4df8-8841-1a5aec3bdef9 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,008 mnist_classifier_MNISTClassifier ywrat4p0 4377fca7-c450-48aa-aefe-895160875d26 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,009 mnist_classifier_MNISTClassifier ywrat4p0 5df61bc0-c288-41c7-828b-9d780532f9c1 -- POST / 200 343.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,012 mnist_classifier_MNISTClassifier ywrat4p0 1cd21f63-1fac-452b-beda-ea6138106022 -- POST / 200 346.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,017 mnist_classifier_MNISTClassifier ywrat4p0 b8c36b78-4de5-4653-bb92-d722e890c1f4 -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,017 mnist_classifier_MNISTClassifier ywrat4p0 d8bfaf06-36d3-404b-a2f2-dd9b9d8391d9 -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,018 mnist_classifier_MNISTClassifier ywrat4p0 3e842e3b-d636-4023-aba2-7e483e73afbe -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,018 mnist_classifier_MNISTClassifier ywrat4p0 49a79af8-07ac-4417-af13-ffc4074aa764 -- POST / 200 351.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,019 mnist_classifier_MNISTClassifier ywrat4p0 04737adf-dd61-4b19-bcff-83f0b2e91cd4 -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,019 mnist_classifier_MNISTClassifier ywrat4p0 897901a1-8bf8-4ede-a448-286a88e7440e -- POST / 200 352.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,020 mnist_classifier_MNISTClassifier ywrat4p0 bf457665-daf0-480f-acc9-d33ff93f2998 -- POST / 200 353.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,024 mnist_classifier_MNISTClassifier ywrat4p0 87ccc1bb-077e-4281-90d2-5feb1c1f999d -- POST / 200 356.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,025 mnist_classifier_MNISTClassifier ywrat4p0 f3884193-3ef2-4d20-83bb-ac35b97c9bf0 -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,026 mnist_classifier_MNISTClassifier ywrat4p0 6ad292f0-3e2f-477f-8005-839f54c07c6d -- POST / 200 358.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,034 mnist_classifier_MNISTClassifier ywrat4p0 b0f7fe74-cbaf-4c94-b423-a7ce74e1f7a9 -- POST / 200 365.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,037 mnist_classifier_MNISTClassifier ywrat4p0 60f1c4e1-fc2b-46fb-b119-cc8e96f50eaa -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,131 mnist_classifier_MNISTClassifier ywrat4p0 00008e26-8bc1-4889-9cda-ac8a9ff742a6 -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,131 mnist_classifier_MNISTClassifier ywrat4p0 582643f0-e752-41fd-be4b-039e1a346ace -- POST / 200 446.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,132 mnist_classifier_MNISTClassifier ywrat4p0 5c2639d3-de82-421a-8450-ede6d8622656 -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,132 mnist_classifier_MNISTClassifier ywrat4p0 c06cc4ea-f66f-478b-8ca4-1215440b2ef6 -- POST / 200 445.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,133 mnist_classifier_MNISTClassifier ywrat4p0 e2d97ea9-4811-49d6-8f88-7c8214b88f06 -- POST / 200 444.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,134 mnist_classifier_MNISTClassifier ywrat4p0 1deb078f-0a5a-4dc3-8145-8fee88544687 -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,134 mnist_classifier_MNISTClassifier ywrat4p0 aca7d68c-8e17-4d1d-a8bf-21f27a628971 -- POST / 200 444.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,135 mnist_classifier_MNISTClassifier ywrat4p0 fa03592a-735f-4cd1-9ed6-5f0e651d534e -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,135 mnist_classifier_MNISTClassifier ywrat4p0 ba701d30-17cc-471d-b7a9-e1ecbe2c461d -- POST / 200 443.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,136 mnist_classifier_MNISTClassifier ywrat4p0 76b52f2e-5504-4650-a405-f6ef8cb3b4b9 -- POST / 200 440.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,136 mnist_classifier_MNISTClassifier ywrat4p0 95887d65-d3d7-433d-8320-dc3c63be9e09 -- POST / 200 438.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,136 mnist_classifier_MNISTClassifier ywrat4p0 19d8aa72-6317-4675-a352-dadf3ee5cce5 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,137 mnist_classifier_MNISTClassifier ywrat4p0 8f7b803c-acab-435f-b0e6-c4c546d66bd2 -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,137 mnist_classifier_MNISTClassifier ywrat4p0 a3d362b2-1b23-41e4-9530-e156eefa0ca8 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,138 mnist_classifier_MNISTClassifier ywrat4p0 ebda0c36-4584-4136-aa21-821f0e074b8a -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,138 mnist_classifier_MNISTClassifier ywrat4p0 126db2de-e339-4eb6-b72d-70c5593a4a34 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,139 mnist_classifier_MNISTClassifier ywrat4p0 d17c1b63-273d-4d9f-a736-0956cb3f518f -- POST / 200 435.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,139 mnist_classifier_MNISTClassifier ywrat4p0 4bf23422-bfc7-4859-8122-2a003c924d48 -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,146 mnist_classifier_MNISTClassifier ywrat4p0 bdf4168c-629e-4d80-acdd-125030e4ea43 -- POST / 200 438.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,149 mnist_classifier_MNISTClassifier ywrat4p0 631dbc2b-1243-4def-8ce3-95d71a487220 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,169 mnist_classifier_MNISTClassifier ywrat4p0 f52438a9-df1d-49c3-94e1-a865d937654a -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,169 mnist_classifier_MNISTClassifier ywrat4p0 b57a40da-c3c7-485b-9da9-9de8173da5b6 -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,170 mnist_classifier_MNISTClassifier ywrat4p0 d40c3007-13ed-44d6-b416-bf64d17c1106 -- POST / 200 219.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,170 mnist_classifier_MNISTClassifier ywrat4p0 8740badb-ec77-4a82-af9a-3a6be778ef2c -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,170 mnist_classifier_MNISTClassifier ywrat4p0 304b0208-b941-4634-b6b5-28efecbe6236 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,170 mnist_classifier_MNISTClassifier ywrat4p0 6bc6861b-730a-4189-8a39-8adddd6e77eb -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,170 mnist_classifier_MNISTClassifier ywrat4p0 d3293b33-322d-4f8f-8bf5-5a4405ea46e5 -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,171 mnist_classifier_MNISTClassifier ywrat4p0 56e36e58-528f-4468-acb3-346c5667aef1 -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,171 mnist_classifier_MNISTClassifier ywrat4p0 0eed1a4a-dcad-4980-8dfa-426ab4505367 -- POST / 200 157.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,171 mnist_classifier_MNISTClassifier ywrat4p0 3493ef59-32ee-4809-9571-0cba82bcf010 -- POST / 200 144.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,171 mnist_classifier_MNISTClassifier ywrat4p0 bf51beec-7d2a-4730-9cd9-f8bb0219b74d -- POST / 200 132.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,171 mnist_classifier_MNISTClassifier ywrat4p0 1286ee78-038d-4809-a99f-ca58f033f8ef -- POST / 200 123.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,172 mnist_classifier_MNISTClassifier ywrat4p0 73285a94-28f8-48f7-bf4d-d49a5794bcf0 -- POST / 200 121.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,172 mnist_classifier_MNISTClassifier ywrat4p0 7c4b4d48-7293-4e61-a9f6-9b9ee352b6c6 -- POST / 200 120.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,172 mnist_classifier_MNISTClassifier ywrat4p0 36bfdd3f-106b-4970-ba2e-85673566a962 -- POST / 200 120.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,172 mnist_classifier_MNISTClassifier ywrat4p0 b1fc9889-7050-4186-a366-ff1e8f14030b -- POST / 200 120.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,173 mnist_classifier_MNISTClassifier ywrat4p0 23887089-1ddf-43fe-bcd5-303a88d6b7c2 -- POST / 200 118.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,174 mnist_classifier_MNISTClassifier ywrat4p0 5053e5a4-6e37-4e08-bb27-ae148b71307f -- POST / 200 464.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,175 mnist_classifier_MNISTClassifier ywrat4p0 7a1e3ac3-13a6-458b-a737-aa7ceb99d730 -- POST / 200 464.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,175 mnist_classifier_MNISTClassifier ywrat4p0 2a9a0c27-7ea0-4cd7-b0c9-16d270e577ec -- POST / 200 462.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,176 mnist_classifier_MNISTClassifier ywrat4p0 66e027da-1858-4131-a0ee-9ef82f42ba47 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,176 mnist_classifier_MNISTClassifier ywrat4p0 ada378fd-6dae-4158-ac52-0d2f3d2f5513 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,176 mnist_classifier_MNISTClassifier ywrat4p0 5d2ff029-b106-4bfc-a52f-6aa49171ebf5 -- POST / 200 462.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,176 mnist_classifier_MNISTClassifier ywrat4p0 7f63a8c5-b634-4db0-8eb0-fdcac66deb91 -- POST / 200 460.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,177 mnist_classifier_MNISTClassifier ywrat4p0 48bb0bdb-f677-431d-9514-e6b2ca7929c0 -- POST / 200 461.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,177 mnist_classifier_MNISTClassifier ywrat4p0 2c470072-f13a-4daa-b666-83c4385d0faf -- POST / 200 461.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,178 mnist_classifier_MNISTClassifier ywrat4p0 04bb0266-17d9-4bb7-bf1e-a3a7b415eb91 -- POST / 200 461.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,178 mnist_classifier_MNISTClassifier ywrat4p0 8d64ebf5-2766-4db0-939e-bd24b392ae13 -- POST / 200 460.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,178 mnist_classifier_MNISTClassifier ywrat4p0 bca78a40-33f0-4b43-b672-18fbeb5f2b04 -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,179 mnist_classifier_MNISTClassifier ywrat4p0 fe0b720b-677f-415d-8e13-e37d22c71b86 -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,179 mnist_classifier_MNISTClassifier ywrat4p0 bef10027-9e7b-41fe-b328-a56f6ff42a11 -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,179 mnist_classifier_MNISTClassifier ywrat4p0 d0c290ec-89e3-47f2-aa2d-aa9169e6b41f -- POST / 200 457.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,180 mnist_classifier_MNISTClassifier ywrat4p0 3b1d058d-3a97-4e26-9c44-fb74d37f0946 -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,180 mnist_classifier_MNISTClassifier ywrat4p0 59bb022e-1c56-4598-9612-6dab50d7d9dd -- POST / 200 456.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,180 mnist_classifier_MNISTClassifier ywrat4p0 691cab00-1296-4c24-b9ca-56e1e95df454 -- POST / 200 443.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,181 mnist_classifier_MNISTClassifier ywrat4p0 0abeef7b-8354-4480-85fc-4504d0157f0c -- POST / 200 441.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,181 mnist_classifier_MNISTClassifier ywrat4p0 74a4e478-74de-46d6-bc32-f8a157d287d2 -- POST / 200 441.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,181 mnist_classifier_MNISTClassifier ywrat4p0 4edc3c13-4a49-483b-96c5-0b2b748443b6 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 4117cbd7-87e0-494e-9a38-7b4391630acf -- POST / 200 433.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 4202a7d7-4e9a-40d0-81c3-482e2dabc3c0 -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 8f3d92f2-d697-4443-b93f-4a20a8504d55 -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 229d5241-b6ef-4efc-b18a-6289f5d358ed -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 69814a8f-d478-4bed-a0d9-9b629e89abc3 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 003d2728-a045-43b5-adfc-9ebe66c3f5b0 -- POST / 200 425.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,182 mnist_classifier_MNISTClassifier ywrat4p0 93a803e9-c6c1-427f-9390-67ae27140325 -- POST / 200 425.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 947f7d19-c3ee-40ff-bc35-51d468ec6f73 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 430e5629-36c3-4cdb-81b9-a4839425817c -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 5410ca98-ee66-46d8-aecd-23310a0f6570 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 83b33483-1a76-4aa2-8f58-ec263b4eaf1f -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 7e61b07f-18ec-4f8c-a968-415c4f1d0188 -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,183 mnist_classifier_MNISTClassifier ywrat4p0 3379ddae-f633-40ef-88bf-28015caca96a -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 2c967e5d-3800-4ffe-8663-0568eaeddba7 -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 fbdf6e28-9449-4546-8755-05ed8ddf7d7f -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 23331bf6-f8de-4fb0-aa3a-326b4c0aa92c -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 601a1d92-baf5-456f-be97-55a8a73a0048 -- POST / 200 419.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 e75a1083-cd33-46a1-ab47-a2629216b2ef -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,184 mnist_classifier_MNISTClassifier ywrat4p0 0cab630c-7bde-467f-85fd-d378f2266907 -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 db4d7858-cdc6-45e7-9232-bdf8c823788a -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 b2d28f97-df1e-4120-8f1c-c4dad271db80 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 968cbbbf-2fb2-47d4-9860-06f8cad5edac -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 cac39641-5ede-465a-957e-dd2cf6913d8f -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 6673705d-3aef-4ecb-9341-96c00714599d -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,185 mnist_classifier_MNISTClassifier ywrat4p0 88e6e24f-e62e-45c7-b837-1ad2aa6b3771 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,186 mnist_classifier_MNISTClassifier ywrat4p0 31928ad4-6c62-4281-b5ff-2d0334c86a26 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,186 mnist_classifier_MNISTClassifier ywrat4p0 ed7c875f-5ef1-4796-9494-ef80a5f4fe43 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,186 mnist_classifier_MNISTClassifier ywrat4p0 e0e2c358-4701-491d-9e34-38764d5cef79 -- POST / 200 130.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,186 mnist_classifier_MNISTClassifier ywrat4p0 44ccac26-fe69-4e9f-9fc0-fb5c739b068b -- POST / 200 130.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,187 mnist_classifier_MNISTClassifier ywrat4p0 6dd373b3-a5db-4cf8-ad15-a05cc3d5b6df -- POST / 200 130.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,187 mnist_classifier_MNISTClassifier ywrat4p0 d6eeb8cb-5193-4994-a9f6-5d73980f05bc -- POST / 200 127.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,187 mnist_classifier_MNISTClassifier ywrat4p0 c933b947-d955-4144-bef8-290ab07d5630 -- POST / 200 126.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,187 mnist_classifier_MNISTClassifier ywrat4p0 1d66d73e-a854-4209-89c6-7f8539d39af3 -- POST / 200 126.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,226 mnist_classifier_MNISTClassifier ywrat4p0 93978ef8-1e04-40f0-9424-ad56f0bac2f9 -- POST / 200 164.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,285 mnist_classifier_MNISTClassifier ywrat4p0 8c743242-fa68-4822-9af2-934efb313493 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,286 mnist_classifier_MNISTClassifier ywrat4p0 140a63d3-11c0-4972-a23b-0e46e75a923e -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,286 mnist_classifier_MNISTClassifier ywrat4p0 cc579cb4-e333-40f9-ba45-c94d66252efa -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,286 mnist_classifier_MNISTClassifier ywrat4p0 31311c4d-f625-4d43-9b85-12eccdfc0ef2 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,287 mnist_classifier_MNISTClassifier ywrat4p0 0c4742b4-0ffa-4932-b1c6-30ef9ef911bb -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,287 mnist_classifier_MNISTClassifier ywrat4p0 db0afd99-98b8-4253-9ddb-2494d4b5abc1 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,287 mnist_classifier_MNISTClassifier ywrat4p0 e67d9acd-3d8d-4fb1-b6f9-3f88480a95d7 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,287 mnist_classifier_MNISTClassifier ywrat4p0 e18774c1-ebba-49bd-b522-9af094cfc539 -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,410 mnist_classifier_MNISTClassifier ywrat4p0 e07ea11c-8a62-4566-aeab-6a9cae7d7934 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,412 mnist_classifier_MNISTClassifier ywrat4p0 efd57cff-ce37-4956-a3c0-401fff14f647 -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,413 mnist_classifier_MNISTClassifier ywrat4p0 5c7590fb-b9be-4ac6-86d0-5c5c5e4a9450 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,414 mnist_classifier_MNISTClassifier ywrat4p0 79fc17f8-35bd-47c2-8baf-c28fffa59df7 -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,415 mnist_classifier_MNISTClassifier ywrat4p0 c52dc54e-afaf-4530-a92d-3fff2c28c970 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,417 mnist_classifier_MNISTClassifier ywrat4p0 7e3b98cd-b9c9-4188-9074-e7da3a025f59 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,417 mnist_classifier_MNISTClassifier ywrat4p0 932d3c32-79ec-45f2-a04c-f3ce65edbb11 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,422 mnist_classifier_MNISTClassifier ywrat4p0 6292272f-d7d6-46a8-92c5-29abf69b0081 -- POST / 200 220.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,424 mnist_classifier_MNISTClassifier ywrat4p0 02282f49-35f5-4775-80df-8542302e913b -- POST / 200 222.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,427 mnist_classifier_MNISTClassifier ywrat4p0 a316c70c-82ed-462a-94c4-bca6bacbdeae -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,436 mnist_classifier_MNISTClassifier ywrat4p0 74b3b560-bb5b-409d-9deb-0444b29f6e0a -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,436 mnist_classifier_MNISTClassifier ywrat4p0 03b95708-28f0-4040-b103-1c7849568910 -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,437 mnist_classifier_MNISTClassifier ywrat4p0 6ff0f391-a73a-4978-903d-5e5b2d8855f3 -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,438 mnist_classifier_MNISTClassifier ywrat4p0 b066aabd-bfa0-4b94-b5fd-a6437a07bc21 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,439 mnist_classifier_MNISTClassifier ywrat4p0 accbe4a6-e060-481a-bec7-d124faece797 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,441 mnist_classifier_MNISTClassifier ywrat4p0 380058d6-9d00-4e1b-af1e-93300524fe62 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,441 mnist_classifier_MNISTClassifier ywrat4p0 6912fc84-f6b6-412d-bdae-740c10237cdb -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,441 mnist_classifier_MNISTClassifier ywrat4p0 8528b508-0f78-4e7e-b8a1-6fd556f586c5 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,532 mnist_classifier_MNISTClassifier ywrat4p0 23782d24-3849-4243-81e5-5d90239fd1a4 -- POST / 200 324.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,539 mnist_classifier_MNISTClassifier ywrat4p0 d443bde9-743a-4726-ab11-0b4f3c1573ca -- POST / 200 330.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,541 mnist_classifier_MNISTClassifier ywrat4p0 68682b20-1dce-46c0-9950-65398b9554ba -- POST / 200 332.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,541 mnist_classifier_MNISTClassifier ywrat4p0 fbd23632-0036-4ed9-885b-aa88095e2c0d -- POST / 200 331.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,542 mnist_classifier_MNISTClassifier ywrat4p0 a9f1a0ca-f636-418c-bdf9-b8b173be0293 -- POST / 200 329.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,543 mnist_classifier_MNISTClassifier ywrat4p0 599d6c38-da7f-4165-886e-15445730dce2 -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,543 mnist_classifier_MNISTClassifier ywrat4p0 934b5f14-acbd-431c-a248-4cede5acc28f -- POST / 200 334.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,544 mnist_classifier_MNISTClassifier ywrat4p0 468de8c5-1f1d-418a-8bb2-d912fd6a80d3 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,545 mnist_classifier_MNISTClassifier ywrat4p0 8207e884-c0d7-44a1-ab24-de7dbca682eb -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,545 mnist_classifier_MNISTClassifier ywrat4p0 7db3dee3-d614-4812-b7eb-62fd2a900b54 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,546 mnist_classifier_MNISTClassifier ywrat4p0 1308a670-57ec-4329-acad-2ae29a774360 -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,546 mnist_classifier_MNISTClassifier ywrat4p0 5d383327-f4ef-42f8-80e0-831f14c73fd0 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,547 mnist_classifier_MNISTClassifier ywrat4p0 f046aa8e-455f-4750-b196-36124592ef79 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,548 mnist_classifier_MNISTClassifier ywrat4p0 5f1243cb-a256-451e-a480-7ef49ebbdb95 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,548 mnist_classifier_MNISTClassifier ywrat4p0 8f69cbeb-eb00-4c9d-9256-d9aafddf1b69 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,549 mnist_classifier_MNISTClassifier ywrat4p0 02b70ca5-ebdb-47e8-8380-ed6ebe36343b -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,550 mnist_classifier_MNISTClassifier ywrat4p0 d877bcb3-69fa-45f8-992f-caa67ecfe355 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,560 mnist_classifier_MNISTClassifier ywrat4p0 d575f1ed-259e-4980-8418-9a2974a52045 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,561 mnist_classifier_MNISTClassifier ywrat4p0 7f62978c-4f0e-4c88-836e-4ee325570a9e -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,562 mnist_classifier_MNISTClassifier ywrat4p0 d889181b-8c85-4d9a-bfa2-af95bb76a205 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,562 mnist_classifier_MNISTClassifier ywrat4p0 cef31e51-4b03-438b-bd9f-cf11a16edfb1 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,562 mnist_classifier_MNISTClassifier ywrat4p0 6d724a71-fd95-435b-bdec-72cb111f9127 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,563 mnist_classifier_MNISTClassifier ywrat4p0 27d30d4d-2fda-4fc3-bab1-f40a7cae33d0 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,564 mnist_classifier_MNISTClassifier ywrat4p0 c59a12aa-20bf-4b07-90fc-937d905b5d3d -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,565 mnist_classifier_MNISTClassifier ywrat4p0 74103bc8-ff23-47a9-b01b-18ed615f9626 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,565 mnist_classifier_MNISTClassifier ywrat4p0 fc7a6686-dfe7-45e5-8ad1-29dd7d297d82 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,566 mnist_classifier_MNISTClassifier ywrat4p0 1ef110da-9411-4f31-ad98-ba5baa9bc86a -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,566 mnist_classifier_MNISTClassifier ywrat4p0 105ed904-4b72-4645-a4fa-abcae0ecca9a -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,566 mnist_classifier_MNISTClassifier ywrat4p0 c8c8be0d-728d-4ad9-af27-38236065838d -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,567 mnist_classifier_MNISTClassifier ywrat4p0 4ca4aa4d-dae2-419f-a2b4-68b0ca116a09 -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,567 mnist_classifier_MNISTClassifier ywrat4p0 152e274b-b68c-4594-80b6-199fd8180da9 -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,567 mnist_classifier_MNISTClassifier ywrat4p0 f373ce98-013f-426f-a003-829005d1e3b5 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,568 mnist_classifier_MNISTClassifier ywrat4p0 7ac1698c-874c-4da4-947e-41260d77493b -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,568 mnist_classifier_MNISTClassifier ywrat4p0 9a8fae9c-bbc7-4b02-9407-c30026ebb838 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,569 mnist_classifier_MNISTClassifier ywrat4p0 0a541af7-6bf9-4423-baa8-a3e2a3854d83 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,569 mnist_classifier_MNISTClassifier ywrat4p0 0eb2fbd4-41ea-430e-8ba8-8a4d24231c82 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,569 mnist_classifier_MNISTClassifier ywrat4p0 8b5b6f2d-1edd-4975-aec9-4d80a5e04f3b -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,570 mnist_classifier_MNISTClassifier ywrat4p0 ac2e07a7-84bc-4602-a043-99363bd9a6b8 -- POST / 200 254.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,570 mnist_classifier_MNISTClassifier ywrat4p0 2723449b-60bb-449d-88de-1a93ff454128 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,571 mnist_classifier_MNISTClassifier ywrat4p0 574705e0-d712-4d23-8970-59dbb924800d -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,571 mnist_classifier_MNISTClassifier ywrat4p0 44217fd8-91b9-4e08-bd99-b02b1f83b4e0 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,571 mnist_classifier_MNISTClassifier ywrat4p0 62c1feef-0451-448e-afe0-3570adc4b64e -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,572 mnist_classifier_MNISTClassifier ywrat4p0 bd98d2aa-1c35-477a-b072-4e0ec3e9f206 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,647 mnist_classifier_MNISTClassifier ywrat4p0 3cd74a4d-19a9-4658-a43b-3151e89eb8c9 -- POST / 200 326.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,649 mnist_classifier_MNISTClassifier ywrat4p0 b849afd7-8258-4353-98eb-52841bd9bb55 -- POST / 200 325.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,649 mnist_classifier_MNISTClassifier ywrat4p0 1dadc88a-db8f-4c98-ad85-2f416d17b487 -- POST / 200 325.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,650 mnist_classifier_MNISTClassifier ywrat4p0 e4007f46-a89f-449a-8dc7-ade794a3084f -- POST / 200 326.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,651 mnist_classifier_MNISTClassifier ywrat4p0 ec91be6d-9655-4604-9830-74fe95e262c6 -- POST / 200 327.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,653 mnist_classifier_MNISTClassifier ywrat4p0 6996d0e3-d2fa-4dc0-a783-179ad08a53e2 -- POST / 200 328.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,656 mnist_classifier_MNISTClassifier ywrat4p0 e26dfb31-a2ee-446e-b4d8-ebb2c1e49578 -- POST / 200 329.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,656 mnist_classifier_MNISTClassifier ywrat4p0 b045278e-fe9a-4dc4-8c36-0e1c37b1c067 -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,657 mnist_classifier_MNISTClassifier ywrat4p0 09d18462-dee7-42a0-bec5-d6b8988a156e -- POST / 200 328.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,657 mnist_classifier_MNISTClassifier ywrat4p0 fa4f4b9f-63ee-4486-9f19-10d0977ed2d9 -- POST / 200 329.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,658 mnist_classifier_MNISTClassifier ywrat4p0 495f4f9c-081f-4275-acb6-c1c3196a82d5 -- POST / 200 329.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,658 mnist_classifier_MNISTClassifier ywrat4p0 3adb711a-7736-4b97-8b72-88b9bb40221b -- POST / 200 328.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,661 mnist_classifier_MNISTClassifier ywrat4p0 77dc601d-61a9-4e33-a033-2ea3d31ec607 -- POST / 200 330.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,662 mnist_classifier_MNISTClassifier ywrat4p0 487e63c9-5fd1-4697-8ccb-7bc931890017 -- POST / 200 331.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,663 mnist_classifier_MNISTClassifier ywrat4p0 51b30815-2224-4695-81e2-79a94aeabc3f -- POST / 200 332.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,667 mnist_classifier_MNISTClassifier ywrat4p0 bd59cab1-4ed5-4370-b503-04a557174da5 -- POST / 200 335.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,667 mnist_classifier_MNISTClassifier ywrat4p0 22689424-f12b-4d52-81ef-bc5024fab8a3 -- POST / 200 329.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,668 mnist_classifier_MNISTClassifier ywrat4p0 6c538cfe-de46-48e1-adec-ac54f20757c4 -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,669 mnist_classifier_MNISTClassifier ywrat4p0 2448a5e3-0fb7-4660-97cc-8d1c456b49e3 -- POST / 200 328.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,670 mnist_classifier_MNISTClassifier ywrat4p0 cfa19bd3-05e1-466f-8cb7-7745d93a2e53 -- POST / 200 328.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,670 mnist_classifier_MNISTClassifier ywrat4p0 c1407d15-4816-4b03-b2c4-97134927f470 -- POST / 200 328.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,672 mnist_classifier_MNISTClassifier ywrat4p0 3c0ca590-ee02-4291-a457-b1dca86806d4 -- POST / 200 328.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,673 mnist_classifier_MNISTClassifier ywrat4p0 0d85182f-79a5-4517-92b3-da85891858fc -- POST / 200 328.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,674 mnist_classifier_MNISTClassifier ywrat4p0 2d58fd25-f962-4d2d-bea3-33c4c4bf82c4 -- POST / 200 329.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,674 mnist_classifier_MNISTClassifier ywrat4p0 0eea28e0-f65e-47cb-8b32-dc7643a214b9 -- POST / 200 327.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,674 mnist_classifier_MNISTClassifier ywrat4p0 4582aade-5b93-4173-88c0-3069f3d0e498 -- POST / 200 327.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,675 mnist_classifier_MNISTClassifier ywrat4p0 cb45642e-22dd-4bfd-b30c-6cc703cc18d8 -- POST / 200 324.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,676 mnist_classifier_MNISTClassifier ywrat4p0 fc197db3-403a-466e-8b63-48fd3f23bfa4 -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,676 mnist_classifier_MNISTClassifier ywrat4p0 f0d6abc5-0d56-47b9-8d4b-5f81b05ba894 -- POST / 200 325.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,676 mnist_classifier_MNISTClassifier ywrat4p0 4fd667a3-78df-4e29-a2ff-bbbc7e83578c -- POST / 200 325.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,678 mnist_classifier_MNISTClassifier ywrat4p0 83959c66-ccc3-445e-8d4a-c8edbdd416ad -- POST / 200 295.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,683 mnist_classifier_MNISTClassifier ywrat4p0 05718f04-5d64-46a7-9a70-926e68b3a00e -- POST / 200 298.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,685 mnist_classifier_MNISTClassifier ywrat4p0 0819d723-2aa1-4d63-8f60-321e9a07971f -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,686 mnist_classifier_MNISTClassifier ywrat4p0 ca36483b-1095-4e3c-ae9a-1acb5c032307 -- POST / 200 298.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,686 mnist_classifier_MNISTClassifier ywrat4p0 f5229e0a-4de7-43c5-b2a5-ce2902c9ca90 -- POST / 200 295.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,692 mnist_classifier_MNISTClassifier ywrat4p0 039b4d6a-10f4-4475-81a8-f8ed4cc32fda -- POST / 200 300.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,694 mnist_classifier_MNISTClassifier ywrat4p0 07099a5c-8ce4-47b8-b6cc-6a30ddcba48a -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,695 mnist_classifier_MNISTClassifier ywrat4p0 c2483c06-5c7c-4500-92b4-8503fb3829c3 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,695 mnist_classifier_MNISTClassifier ywrat4p0 449e7175-7fd7-48a2-a12c-b219e05a9896 -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,695 mnist_classifier_MNISTClassifier ywrat4p0 cafaf441-d104-4fba-8b44-6b3e7cd72055 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,695 mnist_classifier_MNISTClassifier ywrat4p0 2fbf0ce6-8892-486a-a8b4-0888e41e8777 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,698 mnist_classifier_MNISTClassifier ywrat4p0 7cf667a4-2968-4233-b0dd-6512e67b2d9b -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,699 mnist_classifier_MNISTClassifier ywrat4p0 249f044e-4c3f-4e5c-927a-6c8c3ea78472 -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,703 mnist_classifier_MNISTClassifier ywrat4p0 2350c26b-b686-4a4d-ad86-2054f81278b7 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,704 mnist_classifier_MNISTClassifier ywrat4p0 31bb3935-1bbb-4e86-97b3-93d904045bb1 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,704 mnist_classifier_MNISTClassifier ywrat4p0 a412e30e-0241-4f7b-9307-5e116df2aa8a -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,705 mnist_classifier_MNISTClassifier ywrat4p0 fc7283f5-794a-4ba0-8235-9d819eb7d8b3 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,707 mnist_classifier_MNISTClassifier ywrat4p0 86fa3f08-2914-4302-b289-82d52ff4bbaf -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,712 mnist_classifier_MNISTClassifier ywrat4p0 065ff7eb-3eab-4c72-b877-b1700ba45a84 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,713 mnist_classifier_MNISTClassifier ywrat4p0 e93c85ec-008f-4002-95bf-973ef951898a -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,717 mnist_classifier_MNISTClassifier ywrat4p0 f3482525-87ce-4213-9cc3-3aca26123d3a -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,717 mnist_classifier_MNISTClassifier ywrat4p0 b331aeef-2a68-4175-b2f3-5a0b1fa8cbd6 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,717 mnist_classifier_MNISTClassifier ywrat4p0 8e2a685d-fcc3-4929-8f78-3c1f64d4c592 -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,718 mnist_classifier_MNISTClassifier ywrat4p0 8a1f356c-b4c1-4509-afb9-580f6b0e5fb0 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,718 mnist_classifier_MNISTClassifier ywrat4p0 e6c3b073-2d31-4284-bbf2-56191f90333e -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,719 mnist_classifier_MNISTClassifier ywrat4p0 d911c4dd-bd21-44a5-8536-99d464578b4b -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,724 mnist_classifier_MNISTClassifier ywrat4p0 834f9713-3b3b-497c-b8ee-44ea5a984e8f -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,987 mnist_classifier_MNISTClassifier ywrat4p0 40a5617a-9e35-4918-91e0-e6cd1972dbf8 -- POST / 200 409.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,988 mnist_classifier_MNISTClassifier ywrat4p0 f68a0847-5a10-4d35-bae5-8392d1e906e1 -- POST / 200 472.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,989 mnist_classifier_MNISTClassifier ywrat4p0 f87c57fb-a6a6-4f2d-9144-779a9e4a4cd4 -- POST / 200 469.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,990 mnist_classifier_MNISTClassifier ywrat4p0 c46949d6-dd00-430c-b4d5-00eb0cdfb663 -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,992 mnist_classifier_MNISTClassifier ywrat4p0 7ed26c63-c09e-49e1-8875-c664af75ff73 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,993 mnist_classifier_MNISTClassifier ywrat4p0 a84e1ac4-25a3-4fd4-bcb3-13fc0b452f03 -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,996 mnist_classifier_MNISTClassifier ywrat4p0 ac5af1df-c41c-46ed-85d6-8d41a755e75c -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,996 mnist_classifier_MNISTClassifier ywrat4p0 88cbb298-f98c-4504-8b97-5247aa20869b -- POST / 200 417.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,998 mnist_classifier_MNISTClassifier ywrat4p0 078083ab-c574-4760-aeba-7b57a8c92e59 -- POST / 200 416.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:31,999 mnist_classifier_MNISTClassifier ywrat4p0 e28ff13f-23ed-42a9-a75f-3a060c11c746 -- POST / 200 415.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,005 mnist_classifier_MNISTClassifier ywrat4p0 c12347a3-1c03-4013-ae8a-060584a59e32 -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,006 mnist_classifier_MNISTClassifier ywrat4p0 4012f244-c678-4684-9c55-f151f7533ad1 -- POST / 200 422.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,006 mnist_classifier_MNISTClassifier ywrat4p0 6d1e7348-37cc-4254-9246-84b98d12ac8f -- POST / 200 421.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,007 mnist_classifier_MNISTClassifier ywrat4p0 cd60417b-1d15-4803-9b26-8219a741f196 -- POST / 200 419.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,007 mnist_classifier_MNISTClassifier ywrat4p0 38554ed8-97dc-4a21-ad15-2a39e4fb7b16 -- POST / 200 419.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,009 mnist_classifier_MNISTClassifier ywrat4p0 0c43f83d-140f-4bc9-af99-d7581fdfd2f8 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,010 mnist_classifier_MNISTClassifier ywrat4p0 69aa4954-6b2f-4594-8c39-e772f0e4e9c3 -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,011 mnist_classifier_MNISTClassifier ywrat4p0 e80b204b-6e26-4efb-9e78-9e5bb5e6e019 -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,011 mnist_classifier_MNISTClassifier ywrat4p0 6181ccbc-e05e-488e-a6cc-5f250138dae0 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,012 mnist_classifier_MNISTClassifier ywrat4p0 bfa788c2-eb27-48b5-a17c-a5bb2b8f7138 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,012 mnist_classifier_MNISTClassifier ywrat4p0 2da60a38-1bc2-4169-8449-a8de67f6a391 -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,013 mnist_classifier_MNISTClassifier ywrat4p0 5db780a5-2b2c-4f68-a758-7112ff287ba9 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,013 mnist_classifier_MNISTClassifier ywrat4p0 e672f99d-f9bc-481b-8468-6c78f5148bcb -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,014 mnist_classifier_MNISTClassifier ywrat4p0 54f25d94-4c9b-4ea7-a249-f74e22d54712 -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,016 mnist_classifier_MNISTClassifier ywrat4p0 537a04d2-751d-47e7-b445-2570d8aa6a30 -- POST / 200 421.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,017 mnist_classifier_MNISTClassifier ywrat4p0 28ba49c0-dbaf-4dfa-89a7-cc247b593cf7 -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,018 mnist_classifier_MNISTClassifier ywrat4p0 a66955a5-fba5-43d8-9c16-6b99588530bc -- POST / 200 422.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,019 mnist_classifier_MNISTClassifier ywrat4p0 22502db0-7c4f-4388-b72e-5b95a2233a72 -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,019 mnist_classifier_MNISTClassifier ywrat4p0 81fb0d18-4b09-4472-8f2c-896c7341b281 -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,021 mnist_classifier_MNISTClassifier ywrat4p0 6f8247fb-a5b2-43f7-b522-7ca34392c24e -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,022 mnist_classifier_MNISTClassifier ywrat4p0 9343f623-8cc4-4ed2-91ab-e7a5b86bb82d -- POST / 200 422.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,022 mnist_classifier_MNISTClassifier ywrat4p0 2f295123-988d-4ca8-ae54-ff955f1b97df -- POST / 200 422.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,022 mnist_classifier_MNISTClassifier ywrat4p0 5c2088f6-8250-4cd3-aa8b-fccd51a0fe53 -- POST / 200 421.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,023 mnist_classifier_MNISTClassifier ywrat4p0 dc525448-1926-43ba-970d-5769f12d3b5d -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,158 mnist_classifier_MNISTClassifier ywrat4p0 157ae651-11fa-4923-8845-287204628f5f -- POST / 200 556.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,158 mnist_classifier_MNISTClassifier ywrat4p0 997498cd-6594-46f9-807f-1cdf64618426 -- POST / 200 555.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,159 mnist_classifier_MNISTClassifier ywrat4p0 41e46a98-5862-493f-9b3e-158e498eaf1c -- POST / 200 555.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,159 mnist_classifier_MNISTClassifier ywrat4p0 df525593-cef3-4ed1-9edf-0eecd634156c -- POST / 200 555.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,160 mnist_classifier_MNISTClassifier ywrat4p0 7b99174b-6a59-48c7-9243-d5e721bf66eb -- POST / 200 555.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,160 mnist_classifier_MNISTClassifier ywrat4p0 5b038335-1828-4efa-82ce-8089dd1fc185 -- POST / 200 555.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,161 mnist_classifier_MNISTClassifier ywrat4p0 d77782d1-9a01-4089-8711-9ec53d948078 -- POST / 200 553.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,161 mnist_classifier_MNISTClassifier ywrat4p0 72227f10-fbe6-41b7-8d6a-cf082cdb66ec -- POST / 200 553.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,162 mnist_classifier_MNISTClassifier ywrat4p0 92020aba-e318-435b-8d8c-cd28c2c10417 -- POST / 200 552.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,162 mnist_classifier_MNISTClassifier ywrat4p0 66d65837-c292-4484-8798-080c9a3ad584 -- POST / 200 463.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,162 mnist_classifier_MNISTClassifier ywrat4p0 71d266fe-a8fc-4c76-ac80-907863b409be -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,163 mnist_classifier_MNISTClassifier ywrat4p0 32902e79-c0b6-4b37-b3b3-d4dfde9d6335 -- POST / 200 451.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,164 mnist_classifier_MNISTClassifier ywrat4p0 3b819a3e-5ec3-4f91-877c-f66e865e72f4 -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,165 mnist_classifier_MNISTClassifier ywrat4p0 0fcc8dc6-0291-4cbc-a1bc-1b17157849a0 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,165 mnist_classifier_MNISTClassifier ywrat4p0 58d8373c-987e-4cb1-8c3b-ebfbf6eede69 -- POST / 200 435.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,166 mnist_classifier_MNISTClassifier ywrat4p0 283438f7-d7a1-499d-99df-0bb7ec1487d7 -- POST / 200 435.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,166 mnist_classifier_MNISTClassifier ywrat4p0 30d1615d-4d9f-4182-9af0-e1444078d11e -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,167 mnist_classifier_MNISTClassifier ywrat4p0 1a51875d-527e-4d5f-976e-5978fc12c7be -- POST / 200 434.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,167 mnist_classifier_MNISTClassifier ywrat4p0 bd589146-11cc-483f-a6c9-61243a14a3f6 -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,168 mnist_classifier_MNISTClassifier ywrat4p0 9e6c9fcd-9382-488f-9253-634cc8c79654 -- POST / 200 435.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,168 mnist_classifier_MNISTClassifier ywrat4p0 b6e5114d-4a9a-4269-b8ed-8909de55389e -- POST / 200 435.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,168 mnist_classifier_MNISTClassifier ywrat4p0 9a6b6509-e8b9-482d-a1b1-ac5c50d1ad1d -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,169 mnist_classifier_MNISTClassifier ywrat4p0 0d3ba81e-5dc0-4d58-a4f8-090bf755f1ce -- POST / 200 436.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,170 mnist_classifier_MNISTClassifier ywrat4p0 8a39e9d8-19ee-4203-9f87-6d6762d0afbe -- POST / 200 436.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,170 mnist_classifier_MNISTClassifier ywrat4p0 6a795fb9-b5ad-40f7-82ad-91974c810ae3 -- POST / 200 436.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,171 mnist_classifier_MNISTClassifier ywrat4p0 02722c04-4901-4b90-9414-54e9b866c61c -- POST / 200 436.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,172 mnist_classifier_MNISTClassifier ywrat4p0 e8febabb-4dce-4128-bdff-722777ff92a4 -- POST / 200 437.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,172 mnist_classifier_MNISTClassifier ywrat4p0 d1022588-ffde-454a-8877-d06b01c5964e -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,176 mnist_classifier_MNISTClassifier ywrat4p0 87297cbc-8e3e-4c97-93fb-8d654818e6d0 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,177 mnist_classifier_MNISTClassifier ywrat4p0 fdccdc81-85d9-4c0d-a7a0-267dc5d24b76 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,178 mnist_classifier_MNISTClassifier ywrat4p0 1204e2de-11e1-4b3f-b2cc-9e4235958f88 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,178 mnist_classifier_MNISTClassifier ywrat4p0 645cf7ef-fd30-476e-a96d-d54c3bb38ab2 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,179 mnist_classifier_MNISTClassifier ywrat4p0 15db0334-7d18-419d-87ab-b83bb56e0a5f -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,180 mnist_classifier_MNISTClassifier ywrat4p0 46a159bc-3010-4d06-84ea-d9636cef99e9 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,181 mnist_classifier_MNISTClassifier ywrat4p0 0b12d513-0c5b-41cb-a2b8-5a5225d747b9 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,181 mnist_classifier_MNISTClassifier ywrat4p0 a2be48cd-684f-4a18-8f4e-c67bbca0ca3f -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,182 mnist_classifier_MNISTClassifier ywrat4p0 146b8a41-22c3-4568-b6bb-587e9aca1a1d -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,183 mnist_classifier_MNISTClassifier ywrat4p0 22169b92-5c28-4de2-a6a7-e437e04df1c0 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,183 mnist_classifier_MNISTClassifier ywrat4p0 1e4abb1e-7411-4594-b2db-d3c1fd07e696 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,184 mnist_classifier_MNISTClassifier ywrat4p0 66610410-876e-4462-9ddb-5b15d322f933 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,184 mnist_classifier_MNISTClassifier ywrat4p0 fe50bd1e-5ea5-4d72-b6fc-9272fa1779a8 -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,184 mnist_classifier_MNISTClassifier ywrat4p0 e5194f8a-d19d-489f-85c9-1a891dec06c7 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,185 mnist_classifier_MNISTClassifier ywrat4p0 82eb58d6-aacf-4e6f-bca5-f34bc5fbefe9 -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,185 mnist_classifier_MNISTClassifier ywrat4p0 ed0ac4ca-d1e9-4791-9aab-0e794fb7c855 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,185 mnist_classifier_MNISTClassifier ywrat4p0 ef3a9d35-69ad-47ac-ab8b-d9174f04660c -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,186 mnist_classifier_MNISTClassifier ywrat4p0 189ed886-1380-4fea-95e0-8394e309a971 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,186 mnist_classifier_MNISTClassifier ywrat4p0 7d90f1a9-5c48-4f7e-b660-b678b6e7e05e -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,186 mnist_classifier_MNISTClassifier ywrat4p0 1c36ef55-6cd7-46f3-9834-56fd65542a2e -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,186 mnist_classifier_MNISTClassifier ywrat4p0 bb37474d-5b32-4c0d-8923-de93a685a9dc -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 48567e24-576d-49d5-835b-6af244ab25ce -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 6d77b765-5cec-47e1-a628-583fa8103e32 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 53b0d015-de59-4aee-ac1c-92769af98663 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 1cae4ea1-4d2d-4435-9a66-fb2c78715e57 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 5ac3ffba-ba21-4a78-943b-5132ceb12e56 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 d7deec28-52d6-4292-bb7d-072dbc3f6e38 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,187 mnist_classifier_MNISTClassifier ywrat4p0 9b558ce2-6966-4dfa-9260-0e497e1f5425 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 2e16a3c3-4528-4e47-99d9-83ba77e87f80 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 e9285a04-4d4e-4865-bb03-ce2839cf60d0 -- POST / 200 246.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 db55ed28-5b9d-46da-9293-382c7acf26c6 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 eb459182-1931-4510-b27a-04e0e6773a1b -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 fd69e61d-f4e6-4f71-97a0-23a4423ba2d4 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,188 mnist_classifier_MNISTClassifier ywrat4p0 e0d112fd-94d7-4def-994c-ba17223ba7e6 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,195 mnist_classifier_MNISTClassifier ywrat4p0 f451adb9-2f21-4116-b181-870d05ae4c0c -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,195 mnist_classifier_MNISTClassifier ywrat4p0 f0f69319-d130-4811-ade9-57a4afb61ac9 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,196 mnist_classifier_MNISTClassifier ywrat4p0 57e460d9-b928-4d0a-92f1-36a5cc1f9d71 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,197 mnist_classifier_MNISTClassifier ywrat4p0 7939c5ad-ca5f-4b48-aa4c-b92ef9134003 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,200 mnist_classifier_MNISTClassifier ywrat4p0 3418ab53-a1e5-4104-a61e-74177c4e6944 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,201 mnist_classifier_MNISTClassifier ywrat4p0 966d9da5-3248-4747-bfa5-1deb906ed7a4 -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,202 mnist_classifier_MNISTClassifier ywrat4p0 feb413b3-1851-458b-85c2-b08de356872c -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,202 mnist_classifier_MNISTClassifier ywrat4p0 1f2be114-3306-449c-b606-057e07767489 -- POST / 200 171.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 b3cd1b70-4f11-47da-9745-c60c7124d56d -- POST / 200 171.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 70e57cc1-4ee9-4ee8-877b-3b5192916a39 -- POST / 200 170.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 2fa19f67-3b7c-4166-b9a9-d0b34bebb51f -- POST / 200 168.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 b746197c-44df-4d51-97be-42ea65304ca4 -- POST / 200 167.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 b8447237-5e9e-4bb2-b7e6-6393153a502f -- POST / 200 163.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,203 mnist_classifier_MNISTClassifier ywrat4p0 32c059b2-acea-461e-a1e4-cc0170f12533 -- POST / 200 162.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,204 mnist_classifier_MNISTClassifier ywrat4p0 78a297e2-aa4d-466b-862b-095f642fa93c -- POST / 200 160.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,205 mnist_classifier_MNISTClassifier ywrat4p0 086de8e5-83bf-4100-9b3a-81fdaae8737b -- POST / 200 160.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,205 mnist_classifier_MNISTClassifier ywrat4p0 e5c788d4-375b-4087-94d1-e99f23b03859 -- POST / 200 160.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,205 mnist_classifier_MNISTClassifier ywrat4p0 71e8ba2e-9c51-4149-b435-f1c6ebfd8fac -- POST / 200 159.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,205 mnist_classifier_MNISTClassifier ywrat4p0 bceb8489-6eac-4958-a727-fabe670b0956 -- POST / 200 159.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,206 mnist_classifier_MNISTClassifier ywrat4p0 e3c4909e-6334-428a-a21f-30fb39bc42b9 -- POST / 200 158.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,206 mnist_classifier_MNISTClassifier ywrat4p0 15143e32-331b-489e-b57e-e8256ca3594f -- POST / 200 158.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,206 mnist_classifier_MNISTClassifier ywrat4p0 8f496ac6-c341-4f7e-a058-aaede74bbd48 -- POST / 200 156.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,208 mnist_classifier_MNISTClassifier ywrat4p0 dca25d0b-f0dd-492b-b24f-d278b9563ce7 -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,208 mnist_classifier_MNISTClassifier ywrat4p0 d49afa13-9449-4810-a628-17d1d9791d4e -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,208 mnist_classifier_MNISTClassifier ywrat4p0 823e0cbb-8306-427f-b3ac-fc5f53a639ed -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,210 mnist_classifier_MNISTClassifier ywrat4p0 d70eb57f-ddaa-4665-b23f-f9b54b0fbf2a -- POST / 200 159.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,210 mnist_classifier_MNISTClassifier ywrat4p0 87f5f78b-fda2-4d7e-b2fd-2b98e022a2a8 -- POST / 200 157.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,211 mnist_classifier_MNISTClassifier ywrat4p0 203c2277-a5a2-47ed-b5e5-78afc037302f -- POST / 200 156.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,212 mnist_classifier_MNISTClassifier ywrat4p0 629122e4-550c-491d-bdae-bd0d08b97685 -- POST / 200 155.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,212 mnist_classifier_MNISTClassifier ywrat4p0 0163284f-d8c5-45d9-a0d4-df06e4b13a2b -- POST / 200 155.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,212 mnist_classifier_MNISTClassifier ywrat4p0 b2044b9e-adc2-4337-ae2a-fbe89f61a9e5 -- POST / 200 155.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,213 mnist_classifier_MNISTClassifier ywrat4p0 82c1b716-1297-4727-aa6f-d02fc55914a4 -- POST / 200 154.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,214 mnist_classifier_MNISTClassifier ywrat4p0 5fa0dec6-de3a-485b-a6fb-3f32aafc1a10 -- POST / 200 154.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,214 mnist_classifier_MNISTClassifier ywrat4p0 7230c33c-652d-44e6-92a0-3d7bf84e16a4 -- POST / 200 154.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,215 mnist_classifier_MNISTClassifier ywrat4p0 daf7744b-af52-4fb8-9705-496e47eea913 -- POST / 200 153.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,216 mnist_classifier_MNISTClassifier ywrat4p0 8a24950d-0810-4c63-97f1-948251847c70 -- POST / 200 151.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,219 mnist_classifier_MNISTClassifier ywrat4p0 b7b3d4f5-b35c-4038-89bb-522acf206962 -- POST / 200 154.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,220 mnist_classifier_MNISTClassifier ywrat4p0 e615ba93-c372-4881-9ba3-661a82049260 -- POST / 200 155.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,416 mnist_classifier_MNISTClassifier ywrat4p0 3865ea27-359e-48f8-b52f-c7b0fda5bbd7 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,417 mnist_classifier_MNISTClassifier ywrat4p0 ead91b74-23d0-4b7b-bb08-e7008fbbdf42 -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,418 mnist_classifier_MNISTClassifier ywrat4p0 76bbf53f-17f3-4de9-bf7e-0d12e8a5ac09 -- POST / 200 193.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,418 mnist_classifier_MNISTClassifier ywrat4p0 2ef8a8c2-e2dd-4008-a739-e5b63e752745 -- POST / 200 192.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,419 mnist_classifier_MNISTClassifier ywrat4p0 a52bd1ec-1eaf-4a7f-8160-9ee19b5b1ef4 -- POST / 200 192.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,419 mnist_classifier_MNISTClassifier ywrat4p0 d23320f3-1caf-4a7c-8ef9-352676e13a05 -- POST / 200 192.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,420 mnist_classifier_MNISTClassifier ywrat4p0 102f36fd-0fd9-419c-9f50-37e799779e1d -- POST / 200 185.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,420 mnist_classifier_MNISTClassifier ywrat4p0 a03f0d3e-e0e6-4a6e-b20b-b63107f2734a -- POST / 200 192.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,421 mnist_classifier_MNISTClassifier ywrat4p0 8a2513f6-9f7b-402b-b355-5a54a3df4373 -- POST / 200 188.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,422 mnist_classifier_MNISTClassifier ywrat4p0 6648b38e-ee21-4e0d-bf09-da72c0c2fe2b -- POST / 200 188.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,422 mnist_classifier_MNISTClassifier ywrat4p0 062e8c17-1977-4805-900f-0628d417516c -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,424 mnist_classifier_MNISTClassifier ywrat4p0 960f6ce3-401e-4fc0-aa10-8af5f2e2c790 -- POST / 200 145.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,424 mnist_classifier_MNISTClassifier ywrat4p0 d535cda8-907c-4307-99eb-b5ef9f944b15 -- POST / 200 189.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,424 mnist_classifier_MNISTClassifier ywrat4p0 4cd3e96b-fa53-45bb-98e7-e1253b6ae909 -- POST / 200 187.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,425 mnist_classifier_MNISTClassifier ywrat4p0 8b9204ed-e591-4844-8d8c-d31dc53afd85 -- POST / 200 187.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,426 mnist_classifier_MNISTClassifier ywrat4p0 d810e17d-49e1-4eea-9cfd-98601fb8a91c -- POST / 200 187.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,426 mnist_classifier_MNISTClassifier ywrat4p0 086b6be3-4bd2-48c1-a8ff-46426198f3f6 -- POST / 200 188.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,427 mnist_classifier_MNISTClassifier ywrat4p0 f2b21f6c-88b8-452a-b0e5-3014a0df0c6f -- POST / 200 189.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,429 mnist_classifier_MNISTClassifier ywrat4p0 8de3f9db-c83a-45f6-936e-c97e809d2478 -- POST / 200 190.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,429 mnist_classifier_MNISTClassifier ywrat4p0 55367122-b57a-405b-855f-9dbb5667ff88 -- POST / 200 190.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,431 mnist_classifier_MNISTClassifier ywrat4p0 1dbd6ec4-6a34-4f2c-87bd-7cda43b56b97 -- POST / 200 192.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,432 mnist_classifier_MNISTClassifier ywrat4p0 1c327326-e753-44c1-b0dd-a102e3dda5bc -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,434 mnist_classifier_MNISTClassifier ywrat4p0 7eedb6f2-de37-4757-aad1-2b65f54235de -- POST / 200 195.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,435 mnist_classifier_MNISTClassifier ywrat4p0 83a1cb1d-a3ee-45d4-92bb-4df0534a8859 -- POST / 200 195.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,435 mnist_classifier_MNISTClassifier ywrat4p0 3df64310-5ae5-4254-8de9-39463c20b142 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,436 mnist_classifier_MNISTClassifier ywrat4p0 2c1ff59d-3122-459d-888b-3748e547c997 -- POST / 200 195.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,436 mnist_classifier_MNISTClassifier ywrat4p0 62d5edbe-e383-4206-9012-a34e53a7a6f8 -- POST / 200 194.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,437 mnist_classifier_MNISTClassifier ywrat4p0 74df5aca-d00d-43a0-b2e3-71c5ff0188e9 -- POST / 200 194.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,437 mnist_classifier_MNISTClassifier ywrat4p0 9fea5689-45cf-4790-9f47-828d59fd91f0 -- POST / 200 184.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,437 mnist_classifier_MNISTClassifier ywrat4p0 ccce3e1a-48f2-4f6a-bfed-55d6e8f6311b -- POST / 200 184.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,438 mnist_classifier_MNISTClassifier ywrat4p0 124eea49-692a-40f7-8a07-e58de53cafc6 -- POST / 200 180.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,438 mnist_classifier_MNISTClassifier ywrat4p0 96caccb0-4bb2-4441-84ba-37b9cb769333 -- POST / 200 178.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,438 mnist_classifier_MNISTClassifier ywrat4p0 3de846c0-8a33-4992-b99c-f2977ab57975 -- POST / 200 177.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,439 mnist_classifier_MNISTClassifier ywrat4p0 c10f318c-6747-4fa3-aba8-c5e60f5818dc -- POST / 200 176.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,439 mnist_classifier_MNISTClassifier ywrat4p0 f8f6ee19-9581-4643-babc-429b79b569fd -- POST / 200 153.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,439 mnist_classifier_MNISTClassifier ywrat4p0 ce454c34-2b1a-4664-aac7-ea0b9144c491 -- POST / 200 152.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,440 mnist_classifier_MNISTClassifier ywrat4p0 171e9934-9788-4bd2-905b-f89d9b357f55 -- POST / 200 148.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,440 mnist_classifier_MNISTClassifier ywrat4p0 9a84f249-8995-4986-84f0-d2c1b93a9f49 -- POST / 200 146.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,440 mnist_classifier_MNISTClassifier ywrat4p0 586044cf-def2-4333-88e2-98b4e53c70ba -- POST / 200 144.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,441 mnist_classifier_MNISTClassifier ywrat4p0 32292bbe-9155-4547-b860-07e775872589 -- POST / 200 144.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,441 mnist_classifier_MNISTClassifier ywrat4p0 eecf18ce-3f06-47e0-9f70-0963c442ccd1 -- POST / 200 142.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,441 mnist_classifier_MNISTClassifier ywrat4p0 8f5bf8fd-48fb-4efb-b9a3-670355a48979 -- POST / 200 141.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,442 mnist_classifier_MNISTClassifier ywrat4p0 62415e67-de37-4c95-988e-378755395afb -- POST / 200 141.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,442 mnist_classifier_MNISTClassifier ywrat4p0 5bd891ab-7382-4e89-96a2-5d1e9cd48777 -- POST / 200 139.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,442 mnist_classifier_MNISTClassifier ywrat4p0 ca4cd810-715a-42cd-ab8b-c3fcd57ffcdc -- POST / 200 137.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,443 mnist_classifier_MNISTClassifier ywrat4p0 4a0a0621-7ea4-47e7-9f0d-cd873fb162f3 -- POST / 200 137.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,443 mnist_classifier_MNISTClassifier ywrat4p0 2b319d0b-efd8-4a4d-ba4d-ba8848a9c02c -- POST / 200 136.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,443 mnist_classifier_MNISTClassifier ywrat4p0 65202bb2-0111-44f0-adff-67d866eebdab -- POST / 200 136.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,444 mnist_classifier_MNISTClassifier ywrat4p0 0d745afd-0913-4c44-bc4d-fb1c0f973991 -- POST / 200 136.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,444 mnist_classifier_MNISTClassifier ywrat4p0 6a6e8c1e-ebae-4daf-9564-de0a378aefc7 -- POST / 200 133.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,445 mnist_classifier_MNISTClassifier ywrat4p0 e94ac8bd-6f6d-4b23-8780-61de298b45ca -- POST / 200 134.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5037) INFO 2026-06-11 18:39:32,445 mnist_classifier_MNISTClassifier ywrat4p0 7cfc5529-e68e-4c30-8509-80a2e109ff30 -- POST / 200 134.7ms
Processed 1000 requests in 5.15 seconds
Throughput: 194.27 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.