beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-06-29 19:51:51,160 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-06-29 19:51:53,328 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=5051) INFO 2026-06-29 19:51:55,819 proxy 172.17.0.2 -- Proxy starting on node b8eb2d548b843a44526980492b288092769630187c90116dea52129c (HTTP port: 8000).
INFO 2026-06-29 19:51:55,889 serve 4238 -- Started Serve in namespace "serve".
(ProxyActor pid=5051) INFO 2026-06-29 19:51:55,886 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5050) INFO 2026-06-29 19:51:55,989 controller 5050 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5050) INFO 2026-06-29 19:51:55,990 controller 5050 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5051) INFO 2026-06-29 19:51:55,994 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5051) INFO 2026-06-29 19:51:56,001 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fc09461fd00>.
(ServeController pid=5050) INFO 2026-06-29 19:51:56,095 controller 5050 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5051) INFO 2026-06-29 19:52:00,213 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-06-29 19:52:01,015 serve 4238 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,135 mnist_classifier_MNISTClassifier nt74n57a c8405e30-caba-478b-af8a-9ec30096a52e -- POST / 200 422.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,138 mnist_classifier_MNISTClassifier nt74n57a 635d0dff-fa3a-49fa-a120-4ad0afddef93 -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,139 mnist_classifier_MNISTClassifier nt74n57a 44c4831b-e905-4dd1-9da1-f55b80510341 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,140 mnist_classifier_MNISTClassifier nt74n57a 02dd8530-f7ef-4317-923a-9caa4e6bffbf -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,140 mnist_classifier_MNISTClassifier nt74n57a c12b71a7-8b9c-4174-b844-4476f6ff3c7a -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,140 mnist_classifier_MNISTClassifier nt74n57a 5cb92dd9-0f80-4286-a20c-336700f8cb24 -- POST / 200 419.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,141 mnist_classifier_MNISTClassifier nt74n57a e348761d-f99b-4cf6-a0ce-0bc65d61f407 -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,141 mnist_classifier_MNISTClassifier nt74n57a 88eb1fc7-61cc-4136-a3b6-f5ffcb310b44 -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,141 mnist_classifier_MNISTClassifier nt74n57a 6a1c4270-1f4b-4cbd-bc11-1a79b27130e2 -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,142 mnist_classifier_MNISTClassifier nt74n57a c82a4129-8a74-48fd-a1d6-50c6c04df9eb -- POST / 200 414.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,142 mnist_classifier_MNISTClassifier nt74n57a f865e477-a169-42e5-9108-4b191dc0669a -- POST / 200 415.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,144 mnist_classifier_MNISTClassifier nt74n57a e184dfb6-ba8f-4b7e-b22c-9285ca25a2fa -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,144 mnist_classifier_MNISTClassifier nt74n57a e07c87f4-41e6-4e7f-a572-35f37a55e229 -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,145 mnist_classifier_MNISTClassifier nt74n57a 6017a6df-3dfb-465d-b943-384e4718d7bc -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,145 mnist_classifier_MNISTClassifier nt74n57a bec04011-a970-4ca3-aa21-a9399b386b36 -- POST / 200 411.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,146 mnist_classifier_MNISTClassifier nt74n57a b1ff7aca-eac8-4fb2-a243-25784fe1028f -- POST / 200 411.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,147 mnist_classifier_MNISTClassifier nt74n57a cf478043-3291-41b1-a755-038980c21eee -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,148 mnist_classifier_MNISTClassifier nt74n57a 4bd22acf-71d0-4177-a766-44d91dd44bac -- POST / 200 410.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,148 mnist_classifier_MNISTClassifier nt74n57a 160fbc8e-a79e-4769-877c-c4504c1b15ac -- POST / 200 410.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,149 mnist_classifier_MNISTClassifier nt74n57a ab4a0abd-9528-488c-aeb2-d02f2180a865 -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,149 mnist_classifier_MNISTClassifier nt74n57a c176307b-474e-4e17-bb25-dfb1da4182e7 -- POST / 200 411.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,151 mnist_classifier_MNISTClassifier nt74n57a d5e72cc7-fe8e-48cd-8e42-e202cf40b0aa -- POST / 200 412.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,153 mnist_classifier_MNISTClassifier nt74n57a 131d818c-eb3b-4e2b-a788-79a0a651efa7 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,156 mnist_classifier_MNISTClassifier nt74n57a fe058ac3-5dae-4440-b733-a2ec25a4d63d -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,158 mnist_classifier_MNISTClassifier nt74n57a 9a7717a2-9619-4efb-a079-73e62639f656 -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,159 mnist_classifier_MNISTClassifier nt74n57a a2cd72eb-300a-40c8-a37a-ca9c9175a4e8 -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,384 mnist_classifier_MNISTClassifier nt74n57a 3e372de9-9f3f-42ce-b975-b7261bcceebb -- POST / 200 641.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,386 mnist_classifier_MNISTClassifier nt74n57a 8c726520-dc36-4ac7-b9e8-bd9841b127f0 -- POST / 200 641.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,387 mnist_classifier_MNISTClassifier nt74n57a 1547d1a4-3e85-4b08-906c-de1083caa881 -- POST / 200 638.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,387 mnist_classifier_MNISTClassifier nt74n57a b450b93f-e2f2-421f-b539-6076c6ec236f -- POST / 200 638.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,388 mnist_classifier_MNISTClassifier nt74n57a 31282786-b430-449d-b519-96cbdaae68ec -- POST / 200 639.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,389 mnist_classifier_MNISTClassifier nt74n57a 74543151-83ef-48fe-8cf2-4b8927243ea6 -- POST / 200 638.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,389 mnist_classifier_MNISTClassifier nt74n57a c7f151df-8e24-4aa5-a5fa-228ec64707f1 -- POST / 200 639.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,391 mnist_classifier_MNISTClassifier nt74n57a 1727b68e-78f3-497e-b56a-63ce15bf8038 -- POST / 200 639.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,391 mnist_classifier_MNISTClassifier nt74n57a d88f198b-f987-417d-a7b6-bd3e32dd3c83 -- POST / 200 639.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,392 mnist_classifier_MNISTClassifier nt74n57a 1b59d0e1-af51-4aa8-8772-3a86314653d9 -- POST / 200 639.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,447 mnist_classifier_MNISTClassifier nt74n57a 8dcf3df3-bb04-4896-aa86-1570a168aff6 -- POST / 200 691.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,451 mnist_classifier_MNISTClassifier nt74n57a 952a2169-6c5b-4e6d-a691-5c6a9b0af468 -- POST / 200 694.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,453 mnist_classifier_MNISTClassifier nt74n57a 54765250-3d17-42c1-9270-a80581b49468 -- POST / 200 698.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,455 mnist_classifier_MNISTClassifier nt74n57a 028c680e-944b-4318-97b6-4e6de143ea5a -- POST / 200 697.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,455 mnist_classifier_MNISTClassifier nt74n57a 36a8eff6-6f31-48eb-bc85-a6ee326c6b64 -- POST / 200 697.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,456 mnist_classifier_MNISTClassifier nt74n57a 90024577-9562-4099-99df-7ae1e06bfd5c -- POST / 200 698.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,463 mnist_classifier_MNISTClassifier nt74n57a 822ab885-2d77-4b03-b33a-75bf657c760c -- POST / 200 699.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,464 mnist_classifier_MNISTClassifier nt74n57a 34b3513d-6dbb-4fc7-be2a-cbc5cbda7bd7 -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,465 mnist_classifier_MNISTClassifier nt74n57a 619da67d-e3ef-4dc9-bf8d-99798b6fdd0e -- POST / 200 699.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,466 mnist_classifier_MNISTClassifier nt74n57a a56675fa-af93-4449-9acd-a2fed9a6e4d1 -- POST / 200 699.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,467 mnist_classifier_MNISTClassifier nt74n57a fbf05877-d75c-44fc-ad30-3d10cfedc4d9 -- POST / 200 700.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,467 mnist_classifier_MNISTClassifier nt74n57a a77b31db-c51e-4534-af43-f8f6b1928c4c -- POST / 200 699.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,469 mnist_classifier_MNISTClassifier nt74n57a 533352ac-1967-43b5-a8a5-f575ef8da697 -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,469 mnist_classifier_MNISTClassifier nt74n57a 337f4879-bcb2-44bf-9d63-a1064d7fcc2d -- POST / 200 699.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,469 mnist_classifier_MNISTClassifier nt74n57a 11093ff2-511e-44c8-bc2c-0139ef92372b -- POST / 200 700.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,470 mnist_classifier_MNISTClassifier nt74n57a 00ccb1c9-364f-4cf9-8071-66568960c016 -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,473 mnist_classifier_MNISTClassifier nt74n57a dffa0b8e-b3f4-44c6-88b7-0313d9ebe790 -- POST / 200 701.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,473 mnist_classifier_MNISTClassifier nt74n57a 9f7dc590-3b0d-41c2-ae84-93bbb164509f -- POST / 200 699.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,474 mnist_classifier_MNISTClassifier nt74n57a aa09eee2-eb0c-45c3-a344-51dc1da5f347 -- POST / 200 699.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,474 mnist_classifier_MNISTClassifier nt74n57a 2a6438d3-2c39-4291-b29d-149a51b63f64 -- POST / 200 698.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,474 mnist_classifier_MNISTClassifier nt74n57a be4ca47a-f7c2-494e-80a2-3da37666c863 -- POST / 200 697.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,475 mnist_classifier_MNISTClassifier nt74n57a 67f0bf2d-6771-4b34-aa45-4d4ff52ccbb7 -- POST / 200 697.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,476 mnist_classifier_MNISTClassifier nt74n57a b9f185c2-a1be-4e59-89f4-d5aacc4a6af2 -- POST / 200 698.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,477 mnist_classifier_MNISTClassifier nt74n57a 7302facb-2b5d-4d96-b51a-cf3975cb09f6 -- POST / 200 694.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,477 mnist_classifier_MNISTClassifier nt74n57a db454146-d0ea-46d1-80b6-90af20d318de -- POST / 200 693.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,477 mnist_classifier_MNISTClassifier nt74n57a 5185cd48-3b4b-4ceb-934f-75d96c5b2f1f -- POST / 200 693.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,478 mnist_classifier_MNISTClassifier nt74n57a 678ed9b9-93de-4279-85a3-f3f2bdeb30d9 -- POST / 200 693.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,479 mnist_classifier_MNISTClassifier nt74n57a de1d7e53-54c9-4fcf-9c9e-24ca78996b6c -- POST / 200 694.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,480 mnist_classifier_MNISTClassifier nt74n57a b6ca5ad5-7376-40d7-989d-96216659955d -- POST / 200 694.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,564 mnist_classifier_MNISTClassifier nt74n57a 077d57ea-79bf-42e0-a8fd-bd7b71214a43 -- POST / 200 772.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,568 mnist_classifier_MNISTClassifier nt74n57a ec458168-e595-488a-97d7-d9ddfdf1112c -- POST / 200 780.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,569 mnist_classifier_MNISTClassifier nt74n57a 9d4da4b0-82b2-41b5-b0ac-39c0533709f4 -- POST / 200 781.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,569 mnist_classifier_MNISTClassifier nt74n57a f03e6025-37ee-48bc-bbc5-31d2ec81f393 -- POST / 200 776.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,569 mnist_classifier_MNISTClassifier nt74n57a bcf12d2f-bf6a-4de0-92f1-da231f17e6c9 -- POST / 200 779.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,569 mnist_classifier_MNISTClassifier nt74n57a 5fd604c6-24a5-4408-a8d9-38b39911bfae -- POST / 200 777.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,570 mnist_classifier_MNISTClassifier nt74n57a a65ccd57-c49f-4b5f-b58e-fe738faed866 -- POST / 200 775.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,570 mnist_classifier_MNISTClassifier nt74n57a f2492fc4-f0ea-4310-b454-de139356bf16 -- POST / 200 777.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,572 mnist_classifier_MNISTClassifier nt74n57a 0d3bea69-ba8c-4f79-88b2-51f49f2b26ac -- POST / 200 777.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,574 mnist_classifier_MNISTClassifier nt74n57a 6cfdd5e6-689f-49e2-bb95-9fb5f5e2f27c -- POST / 200 779.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,579 mnist_classifier_MNISTClassifier nt74n57a 72753173-70bd-4cef-8f70-9ead61c677be -- POST / 200 782.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,580 mnist_classifier_MNISTClassifier nt74n57a 79a96412-2716-40b4-9489-2b9e5228d433 -- POST / 200 781.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,580 mnist_classifier_MNISTClassifier nt74n57a 13eea3d8-22d8-4b38-b11e-bc705647fe5e -- POST / 200 780.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,581 mnist_classifier_MNISTClassifier nt74n57a 09a82136-5357-475c-93c8-94f3028f706c -- POST / 200 780.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,581 mnist_classifier_MNISTClassifier nt74n57a f62d1c95-da84-402e-b955-36820314127a -- POST / 200 779.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,581 mnist_classifier_MNISTClassifier nt74n57a 4365712f-4ccf-4863-937c-7223327234cf -- POST / 200 779.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,581 mnist_classifier_MNISTClassifier nt74n57a 578f382d-ccaf-4c27-9849-ddb2a410c0e0 -- POST / 200 778.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,584 mnist_classifier_MNISTClassifier nt74n57a 78b3c43c-da18-46b7-ad7b-94c03a434db2 -- POST / 200 780.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,585 mnist_classifier_MNISTClassifier nt74n57a 6d2d5a06-a55d-4749-8ee9-b4df8776b78e -- POST / 200 781.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,587 mnist_classifier_MNISTClassifier nt74n57a 57c31d50-4ab3-4318-95d6-8b741887bb67 -- POST / 200 780.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,587 mnist_classifier_MNISTClassifier nt74n57a ea8c5ff9-f417-42b5-b3c3-39904aac757f -- POST / 200 776.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,587 mnist_classifier_MNISTClassifier nt74n57a 2451e82a-41fd-405b-ba30-d54ef3428582 -- POST / 200 775.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,587 mnist_classifier_MNISTClassifier nt74n57a 9b17e730-273c-4dee-b2f7-15c0fd91758f -- POST / 200 772.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,588 mnist_classifier_MNISTClassifier nt74n57a 1dd127bc-1cb9-42ac-82b9-adfb8e1cd868 -- POST / 200 771.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,588 mnist_classifier_MNISTClassifier nt74n57a e6619eca-8ebb-4560-895b-06251695b04b -- POST / 200 776.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,589 mnist_classifier_MNISTClassifier nt74n57a 55ed9292-1f76-46f4-b1d2-04236058b33f -- POST / 200 774.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,589 mnist_classifier_MNISTClassifier nt74n57a d35e9215-ff11-42c3-a9d6-02b48722d4d9 -- POST / 200 773.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,589 mnist_classifier_MNISTClassifier nt74n57a 3f1bf3d6-f084-4deb-b247-c3ba9038bf51 -- POST / 200 771.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,590 mnist_classifier_MNISTClassifier nt74n57a 53e73cdf-89e7-446d-a682-1625271f1236 -- POST / 200 774.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,590 mnist_classifier_MNISTClassifier nt74n57a e53ca10a-226d-4bb5-ac26-1ca8a664d811 -- POST / 200 771.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,591 mnist_classifier_MNISTClassifier nt74n57a af72b597-70b0-45ea-9e96-ec3db678ad51 -- POST / 200 770.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,591 mnist_classifier_MNISTClassifier nt74n57a 221e0efb-6847-4c77-abfb-cd6c75dc9a4c -- POST / 200 770.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,591 mnist_classifier_MNISTClassifier nt74n57a a8e1fb1c-4879-4a7e-8aae-8675136fc216 -- POST / 200 769.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,592 mnist_classifier_MNISTClassifier nt74n57a 22ee525c-6772-4d5c-a234-feab2c9e8664 -- POST / 200 769.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,592 mnist_classifier_MNISTClassifier nt74n57a 577c9a92-fb42-49b2-84fa-b1640604d958 -- POST / 200 767.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,592 mnist_classifier_MNISTClassifier nt74n57a 5453a70e-01d3-40fe-9e43-f3e7f5f50988 -- POST / 200 469.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,593 mnist_classifier_MNISTClassifier nt74n57a 1238bf0c-3ed5-46ba-99cb-e366dca53d5b -- POST / 200 465.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,595 mnist_classifier_MNISTClassifier nt74n57a 21847beb-86e5-4a5f-99aa-a0a6ff3a7f8d -- POST / 200 464.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,595 mnist_classifier_MNISTClassifier nt74n57a a4f548a8-2d42-4533-aa9d-be7bafec8ed4 -- POST / 200 463.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,596 mnist_classifier_MNISTClassifier nt74n57a f79595bd-d775-4288-b337-93a48f3019b2 -- POST / 200 432.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,598 mnist_classifier_MNISTClassifier nt74n57a 9356459e-0628-4fff-a7c6-10ca6b64007e -- POST / 200 433.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,598 mnist_classifier_MNISTClassifier nt74n57a ee50a1c5-d1ab-4590-9bf9-f8300f839719 -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,599 mnist_classifier_MNISTClassifier nt74n57a 84211884-f95a-4649-a814-904ce305559d -- POST / 200 433.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,599 mnist_classifier_MNISTClassifier nt74n57a ea604740-3886-43f5-b7af-a15954f2bf57 -- POST / 200 433.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,602 mnist_classifier_MNISTClassifier nt74n57a 6586101b-fffc-420b-b6a2-4dc23587dbb2 -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,605 mnist_classifier_MNISTClassifier nt74n57a cf70dec3-9a1d-4de1-a504-e824dce3bcdd -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,606 mnist_classifier_MNISTClassifier nt74n57a 86b041b7-f01a-469a-84c2-9aebf4378ffb -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,606 mnist_classifier_MNISTClassifier nt74n57a 79a7b426-c34e-4486-a604-f807f74f6bf6 -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,606 mnist_classifier_MNISTClassifier nt74n57a e2bd2c28-2e49-43ee-90ce-c170e3d5bd3f -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,607 mnist_classifier_MNISTClassifier nt74n57a a65b2dde-7772-4416-ba24-d642d8d66462 -- POST / 200 429.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,608 mnist_classifier_MNISTClassifier nt74n57a f462021e-d99b-4a0d-905a-6620795eedb2 -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,608 mnist_classifier_MNISTClassifier nt74n57a 8e3f16f9-1e72-4ac5-8dd5-f600bcbc77de -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,613 mnist_classifier_MNISTClassifier nt74n57a ae38980c-cae0-4ddb-be7d-5ccee19caf71 -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,614 mnist_classifier_MNISTClassifier nt74n57a d6caf290-d2cc-4bd9-b5fd-ad7b5bac9200 -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,617 mnist_classifier_MNISTClassifier nt74n57a 223987fa-bd0c-47da-bbb6-f1fcacd947a2 -- POST / 200 435.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,620 mnist_classifier_MNISTClassifier nt74n57a 242b7584-b7f1-4e55-9d3c-c4e3bd8d288a -- POST / 200 437.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,622 mnist_classifier_MNISTClassifier nt74n57a eb46c676-9e0f-47db-ab92-9a2c320340df -- POST / 200 437.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,622 mnist_classifier_MNISTClassifier nt74n57a c80e5eee-85aa-470a-85f7-edc9caa2a86a -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,624 mnist_classifier_MNISTClassifier nt74n57a b9ccd45c-5ad8-4c4e-a14d-6f9a01edf3db -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,624 mnist_classifier_MNISTClassifier nt74n57a 70d17d2e-8786-4915-810e-dd7f6053bbfc -- POST / 200 436.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,624 mnist_classifier_MNISTClassifier nt74n57a 8c657cb9-3c93-402b-83e4-639813fa0521 -- POST / 200 437.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,624 mnist_classifier_MNISTClassifier nt74n57a bef581db-2f6e-4d34-9261-3b63ba5a2453 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a 13928a83-4609-4baa-9e86-736f41be0e56 -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a f68068ff-1975-4c9d-9918-90075f731ceb -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a f522ddca-def8-4a51-a395-880b8cffa4ae -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a 08c610dc-b517-42d7-a5fb-3c0d980a9aef -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a 8b89327e-042c-41f4-8a79-9d3dab0de46c -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a c26e9c00-190f-4dd8-a000-895b1b0b0baf -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,625 mnist_classifier_MNISTClassifier nt74n57a 06dc1cc0-6510-4ee2-9725-2c6e43978e02 -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,626 mnist_classifier_MNISTClassifier nt74n57a 5e3ee005-84b1-4eab-98a8-06aaa62addf7 -- POST / 200 246.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,626 mnist_classifier_MNISTClassifier nt74n57a 186b6242-a958-462e-b690-f4faf8c33ffe -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,704 mnist_classifier_MNISTClassifier nt74n57a e88b4340-8e44-4d8a-97b2-453dbcc1c756 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,718 mnist_classifier_MNISTClassifier nt74n57a f9bc9a3f-2411-404f-a0e4-1cd466d37d9d -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,720 mnist_classifier_MNISTClassifier nt74n57a e418f900-008d-4af4-a01e-dbd04c4fe9d6 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,721 mnist_classifier_MNISTClassifier nt74n57a 77a7d47d-4888-47a0-a129-251a45340a9f -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,721 mnist_classifier_MNISTClassifier nt74n57a 0a94adc6-ffac-4a54-a66d-cea4a4a18464 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,721 mnist_classifier_MNISTClassifier nt74n57a ef65acf5-ade3-4efa-b993-7dcebc7f5edf -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,721 mnist_classifier_MNISTClassifier nt74n57a 55de0ff3-3c46-426c-8c0b-db982f4fe2fd -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,722 mnist_classifier_MNISTClassifier nt74n57a 55d90e35-cbb3-4e7e-b15d-47769053a91d -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,722 mnist_classifier_MNISTClassifier nt74n57a e54cd101-19db-44e9-80b6-3180776dbe72 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,722 mnist_classifier_MNISTClassifier nt74n57a ba7e35ff-0618-4623-a769-8603d079b124 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,722 mnist_classifier_MNISTClassifier nt74n57a f6e2628a-40b6-46e1-b4b1-e9cee3895ba8 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,723 mnist_classifier_MNISTClassifier nt74n57a 621fa842-69c0-489e-aeb5-f13519a246ae -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,723 mnist_classifier_MNISTClassifier nt74n57a 09ce16d7-cfc9-4226-8e7a-c68d6aec13a8 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,723 mnist_classifier_MNISTClassifier nt74n57a 13da66be-5c5f-485c-9c3d-9443f8e15960 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,723 mnist_classifier_MNISTClassifier nt74n57a d4457335-f2e4-4d77-a579-1da7bc6941ab -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,723 mnist_classifier_MNISTClassifier nt74n57a 82759588-e679-406b-971c-452539a6455f -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,724 mnist_classifier_MNISTClassifier nt74n57a 7aa9a627-880a-43db-a4c3-0892c26c13fc -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,724 mnist_classifier_MNISTClassifier nt74n57a 7c5b8a4c-e16f-4827-9bab-f773f3d6c380 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,724 mnist_classifier_MNISTClassifier nt74n57a 377d7b13-dc56-4f41-baee-6bf9b1434a21 -- POST / 200 212.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,724 mnist_classifier_MNISTClassifier nt74n57a 1346d7e0-0a56-465b-be20-db112743c6c7 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,725 mnist_classifier_MNISTClassifier nt74n57a b103299a-8b3c-4c79-af20-6aa45ef7ad60 -- POST / 200 204.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,725 mnist_classifier_MNISTClassifier nt74n57a ecb983e2-75cf-44c5-8e47-75af2b87b377 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,725 mnist_classifier_MNISTClassifier nt74n57a 9979ebb0-1d35-43c2-b63b-754fe679230b -- POST / 200 201.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,725 mnist_classifier_MNISTClassifier nt74n57a ac831356-dd99-4979-a8aa-39b7f2dcd981 -- POST / 200 199.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,725 mnist_classifier_MNISTClassifier nt74n57a 0737a5fb-7f0d-4dcc-bffd-0ef990201f71 -- POST / 200 198.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,726 mnist_classifier_MNISTClassifier nt74n57a 4819543e-725a-4c1d-a598-d99c1f10011f -- POST / 200 198.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,726 mnist_classifier_MNISTClassifier nt74n57a 013bd2ec-56fd-4a7c-ab34-678b44c3f0f4 -- POST / 200 197.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,726 mnist_classifier_MNISTClassifier nt74n57a d5a924d1-f195-459f-b326-76d621d39df2 -- POST / 200 196.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,726 mnist_classifier_MNISTClassifier nt74n57a 268a7d62-c82d-4f24-8ec6-d195cea03095 -- POST / 200 195.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,726 mnist_classifier_MNISTClassifier nt74n57a 19ad9071-f064-45e2-ac2c-4610d3b598d5 -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,727 mnist_classifier_MNISTClassifier nt74n57a 9c7e0ec8-8fc2-4825-aa94-7303ba650671 -- POST / 200 167.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,727 mnist_classifier_MNISTClassifier nt74n57a f213e52b-dc08-4e44-8f6c-7a6b58bcf7bd -- POST / 200 129.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,735 mnist_classifier_MNISTClassifier nt74n57a 12c24567-66d0-45a4-9243-8cee0d7d9c58 -- POST / 200 137.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,736 mnist_classifier_MNISTClassifier nt74n57a 92745bdd-b111-4ee1-9f54-f3f5450468e2 -- POST / 200 122.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,854 mnist_classifier_MNISTClassifier nt74n57a ed9cff23-bdae-40d2-b5f9-908acc63efa0 -- POST / 200 227.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,858 mnist_classifier_MNISTClassifier nt74n57a f90c4c67-abae-4e42-9c91-a320fe94badf -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,859 mnist_classifier_MNISTClassifier nt74n57a a475d863-da3b-4e78-8ae0-8bd230ebcc6b -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,859 mnist_classifier_MNISTClassifier nt74n57a 7cce6f1c-5a0d-47dc-81ed-3403a028f865 -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,859 mnist_classifier_MNISTClassifier nt74n57a 3f410e78-b79a-4f55-bd92-b5e2a6ac7186 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,860 mnist_classifier_MNISTClassifier nt74n57a 0de596c1-3a54-4c3a-898b-6299ae29e9fe -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,860 mnist_classifier_MNISTClassifier nt74n57a 6fecce08-c19c-42e0-b94f-0dc32352e946 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,861 mnist_classifier_MNISTClassifier nt74n57a 6c3aa8ca-4aea-4956-bc8e-3791cdb18fd0 -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,862 mnist_classifier_MNISTClassifier nt74n57a d39df28d-336a-417d-a9a1-999ee1107869 -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,862 mnist_classifier_MNISTClassifier nt74n57a 05db52a2-9670-4f85-8119-da2605670418 -- POST / 200 216.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,863 mnist_classifier_MNISTClassifier nt74n57a 0747f96b-d98c-4daf-a49b-adcef2905575 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,863 mnist_classifier_MNISTClassifier nt74n57a f88cc7e2-ee36-4d9e-8a66-5da124a7d177 -- POST / 200 214.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,864 mnist_classifier_MNISTClassifier nt74n57a a8674e6b-c1f6-40de-8bae-c7c7c1e95df8 -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,865 mnist_classifier_MNISTClassifier nt74n57a 49d786cf-4517-492e-b3e5-564581b891fd -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,866 mnist_classifier_MNISTClassifier nt74n57a 00185d59-9dd0-4891-b384-502eadfa5a82 -- POST / 200 213.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,866 mnist_classifier_MNISTClassifier nt74n57a 4ec572ca-078a-4d4c-b837-5df4d9af1694 -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,867 mnist_classifier_MNISTClassifier nt74n57a 90c9118f-ad91-48cc-96b0-265d979ba83b -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,867 mnist_classifier_MNISTClassifier nt74n57a a49b5a83-576d-4971-bdb4-88b8911e6dc8 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,868 mnist_classifier_MNISTClassifier nt74n57a 624ce36f-6a1b-4cdf-9f13-a19e10cf4196 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,868 mnist_classifier_MNISTClassifier nt74n57a a0fe21e2-4d9f-4423-9897-8daed07d36da -- POST / 200 212.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,869 mnist_classifier_MNISTClassifier nt74n57a b82705a4-02b3-4e9b-a40f-bb29a06511aa -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,869 mnist_classifier_MNISTClassifier nt74n57a 55ec9c24-c3cd-4a09-9bd3-6767b60ebf12 -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,871 mnist_classifier_MNISTClassifier nt74n57a b1ce6469-a3ea-4139-bf91-de7774c6f012 -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:02,871 mnist_classifier_MNISTClassifier nt74n57a 468a1135-1ffe-48a1-8586-172178be8408 -- POST / 200 214.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,018 mnist_classifier_MNISTClassifier nt74n57a cf603e80-3f53-443e-a4cc-a935c12d5fcf -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,018 mnist_classifier_MNISTClassifier nt74n57a eafaa9db-9f7b-4916-84df-f5be79ddac33 -- POST / 200 361.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,019 mnist_classifier_MNISTClassifier nt74n57a 007edba2-6220-4519-8f2d-4d2b17afce80 -- POST / 200 359.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,019 mnist_classifier_MNISTClassifier nt74n57a 9814c15c-193c-4315-a033-734d8db5516b -- POST / 200 359.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,021 mnist_classifier_MNISTClassifier nt74n57a c23bdb6e-80ed-4e1c-9db4-4b7ad9b29b82 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,021 mnist_classifier_MNISTClassifier nt74n57a b37641e8-d97c-4692-8a15-b7b34596ccbd -- POST / 200 355.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,021 mnist_classifier_MNISTClassifier nt74n57a 221f2bbb-8678-457a-ba10-aca86af5e453 -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,022 mnist_classifier_MNISTClassifier nt74n57a 8af27620-eacc-4129-bb6e-c1b54c8917d0 -- POST / 200 353.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,022 mnist_classifier_MNISTClassifier nt74n57a de01403b-fd35-4f9a-a455-4b52f7dae7ec -- POST / 200 349.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,022 mnist_classifier_MNISTClassifier nt74n57a 95d1685c-dd61-4978-8e91-1e6dff300740 -- POST / 200 347.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,023 mnist_classifier_MNISTClassifier nt74n57a 349a60d7-408b-4629-a01d-7fae94178f85 -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,023 mnist_classifier_MNISTClassifier nt74n57a b66b406c-87b6-4c90-8c28-453b22e17061 -- POST / 200 345.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,024 mnist_classifier_MNISTClassifier nt74n57a 34fe744e-e15f-4934-a388-9674df7f0d80 -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,024 mnist_classifier_MNISTClassifier nt74n57a 33c01fa4-6ce9-483a-8d68-60c2ec420a54 -- POST / 200 343.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,027 mnist_classifier_MNISTClassifier nt74n57a e25a3ef6-42b1-4417-a338-c398c1fed022 -- POST / 200 337.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,027 mnist_classifier_MNISTClassifier nt74n57a 25b3fe90-fc8c-4f87-9631-1c4f8b4fc752 -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,028 mnist_classifier_MNISTClassifier nt74n57a e0e4e338-cdfb-47ca-beaa-f460552b9be1 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,029 mnist_classifier_MNISTClassifier nt74n57a 103a747b-c2b3-4ce3-86d1-97f1f10dce3a -- POST / 200 290.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,030 mnist_classifier_MNISTClassifier nt74n57a 57d3c64c-fa29-4cc3-8e0f-c0c1450a8fce -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,031 mnist_classifier_MNISTClassifier nt74n57a d2b20629-e69c-49f5-b0f7-fc41b8be9e0b -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,031 mnist_classifier_MNISTClassifier nt74n57a 6e55d949-0142-4036-8c43-21636c29971e -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,031 mnist_classifier_MNISTClassifier nt74n57a 96417d20-518c-4306-9d56-688d9a72fa5d -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,032 mnist_classifier_MNISTClassifier nt74n57a 2bbfdf0b-acad-479a-9904-42989548c533 -- POST / 200 289.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,033 mnist_classifier_MNISTClassifier nt74n57a a2f7d4c6-2a7c-4ef9-bf57-7bfdd0785f0d -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,033 mnist_classifier_MNISTClassifier nt74n57a 6109bca7-9094-44cd-9e31-356cb15e0230 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,033 mnist_classifier_MNISTClassifier nt74n57a 8cca2aaa-0663-4d72-8a64-f99784d39b21 -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,034 mnist_classifier_MNISTClassifier nt74n57a f304f933-39f2-4482-a68c-23d40f20a869 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,034 mnist_classifier_MNISTClassifier nt74n57a 506b0c2b-fe4d-4b46-ae9e-6ca3fde96934 -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,034 mnist_classifier_MNISTClassifier nt74n57a 273efa9e-1ffa-4a5f-9acf-3717c4c30e98 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,035 mnist_classifier_MNISTClassifier nt74n57a 3237d62c-82dd-47ae-8c9f-7b1d79daacc7 -- POST / 200 267.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,035 mnist_classifier_MNISTClassifier nt74n57a a2f6f318-e669-47e3-8192-e6df4e972747 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,035 mnist_classifier_MNISTClassifier nt74n57a 319155e6-c951-4a90-b68a-b337cd74ed4b -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,036 mnist_classifier_MNISTClassifier nt74n57a e1e980a0-c879-4e02-a837-640c41f365c7 -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,036 mnist_classifier_MNISTClassifier nt74n57a c99798ba-98f6-40c7-9b6f-e7c1bbf8112c -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,036 mnist_classifier_MNISTClassifier nt74n57a 7e4e8571-7247-4563-8a73-d893a0ded774 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,036 mnist_classifier_MNISTClassifier nt74n57a d9a88390-fc5a-4e70-95d0-b4c508e7fd15 -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,037 mnist_classifier_MNISTClassifier nt74n57a c5abd461-b019-4d3a-b0e3-2ce64402f592 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,037 mnist_classifier_MNISTClassifier nt74n57a 96cc84ac-527e-4c35-8fe3-9226ffe6f0ec -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,038 mnist_classifier_MNISTClassifier nt74n57a 907387e5-7937-472d-b0a7-5ad9a928fbb9 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,039 mnist_classifier_MNISTClassifier nt74n57a e049b3e5-c8dc-49fe-a71f-38df98588cba -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,039 mnist_classifier_MNISTClassifier nt74n57a ac1b0560-4bc1-41b4-9c20-ef46a5b30610 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,040 mnist_classifier_MNISTClassifier nt74n57a 407549be-6be8-422d-9c77-38cef5e2433d -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,041 mnist_classifier_MNISTClassifier nt74n57a 44d59401-2cca-4273-bc4d-0dbf7134c6c4 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,041 mnist_classifier_MNISTClassifier nt74n57a db06cbce-6b48-49be-ba66-4971e67dd4d5 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,042 mnist_classifier_MNISTClassifier nt74n57a dacb2d5d-c758-4f07-8270-ae3965ced6a7 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,042 mnist_classifier_MNISTClassifier nt74n57a cefdcc39-eaa4-43e7-b661-0f02cecf9845 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,043 mnist_classifier_MNISTClassifier nt74n57a 6565c1e4-b7e8-43da-8753-40992c79077d -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,045 mnist_classifier_MNISTClassifier nt74n57a d417da9d-46b3-41d1-a177-a7979c64e9b7 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,046 mnist_classifier_MNISTClassifier nt74n57a 0291e4a8-0ec6-4f96-89b8-03de7df82d60 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,046 mnist_classifier_MNISTClassifier nt74n57a d94b4c91-8670-42e1-a2ed-1a8a73790327 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,046 mnist_classifier_MNISTClassifier nt74n57a 5358b099-2af4-4a16-84e3-7b2216369b75 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,047 mnist_classifier_MNISTClassifier nt74n57a 78ab473a-5b37-4d80-8cf0-3d90ba9a5bb2 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,047 mnist_classifier_MNISTClassifier nt74n57a ddca2102-dc34-4952-9cc0-3999ba8cdbee -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,047 mnist_classifier_MNISTClassifier nt74n57a 9bbb74d5-a1d3-4b13-85b6-9fccd11bc5c6 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,048 mnist_classifier_MNISTClassifier nt74n57a b03aa28f-f313-4408-a3f5-c2e1a5ae3499 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,048 mnist_classifier_MNISTClassifier nt74n57a fc9bedcf-1e46-4b2e-9af8-fb82e3ec4641 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,048 mnist_classifier_MNISTClassifier nt74n57a ad2dcfc5-209c-4853-89d5-70c2666bec36 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,048 mnist_classifier_MNISTClassifier nt74n57a 7c99d040-3b68-44b1-bc3a-75263594f8e6 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,048 mnist_classifier_MNISTClassifier nt74n57a 44114c14-7904-4b46-bf17-7e1bfa0d464a -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,049 mnist_classifier_MNISTClassifier nt74n57a ae265bd7-be52-4900-a707-06a384a20f21 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,049 mnist_classifier_MNISTClassifier nt74n57a df15a9ae-4ea6-441c-b5ad-6c9e4b28ee5b -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,049 mnist_classifier_MNISTClassifier nt74n57a 4aa17078-0401-4fbe-960f-78ff8f148cf5 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,050 mnist_classifier_MNISTClassifier nt74n57a d631ba13-09ea-404b-b76c-621740133dae -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,050 mnist_classifier_MNISTClassifier nt74n57a ebeef8e4-3d4a-4943-a5f7-83d44cc71a53 -- POST / 200 226.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,050 mnist_classifier_MNISTClassifier nt74n57a 24b2e360-46cc-4326-af78-5f6a9b28a4d3 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,050 mnist_classifier_MNISTClassifier nt74n57a 56cbed7e-396c-42d6-8237-0190863e0fb9 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,050 mnist_classifier_MNISTClassifier nt74n57a 5f8b2b64-d337-4700-b46a-fcf3e86df49e -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,051 mnist_classifier_MNISTClassifier nt74n57a 8010fd83-7da2-4c15-902c-65ea72fc7346 -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,051 mnist_classifier_MNISTClassifier nt74n57a ba0e110f-a100-416b-a5c8-b126fc7c6be4 -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,052 mnist_classifier_MNISTClassifier nt74n57a 70110a4e-0a76-4f8a-ad36-92832c0d0180 -- POST / 200 222.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,056 mnist_classifier_MNISTClassifier nt74n57a b2ecb1bf-edef-46a9-9d66-606eaf568366 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,056 mnist_classifier_MNISTClassifier nt74n57a 1a0aa5e4-5668-42c6-a717-4e4bc3eeeadf -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,056 mnist_classifier_MNISTClassifier nt74n57a e96c1e5d-ee99-47a7-9722-a5df9673f453 -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a d2f91752-3ece-4ffc-a1d2-a64e122b1101 -- POST / 200 221.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a 2d04ff85-594f-4606-add0-3b9d07ff09d2 -- POST / 200 219.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a 1cb7e0ee-b3d0-4a4c-a5ac-41ce6194c50d -- POST / 200 219.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a ec2b32c9-f850-47c9-9db7-0257d0847025 -- POST / 200 171.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a c612a2fb-4232-4358-8a31-f99b8eac81a6 -- POST / 200 166.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,057 mnist_classifier_MNISTClassifier nt74n57a 4f23993c-ce54-48dc-9dde-84681fd4ddc1 -- POST / 200 164.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,059 mnist_classifier_MNISTClassifier nt74n57a 6bdac573-7d19-4c06-8eee-84208b88115e -- POST / 200 165.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,060 mnist_classifier_MNISTClassifier nt74n57a df77ddc1-3c91-4fd8-8833-bae7c9c631b1 -- POST / 200 165.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,061 mnist_classifier_MNISTClassifier nt74n57a e39e7603-193c-4e98-9de4-537e20367c67 -- POST / 200 165.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,061 mnist_classifier_MNISTClassifier nt74n57a 5810aeb4-e929-45e0-905b-617e38a41bd9 -- POST / 200 158.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,062 mnist_classifier_MNISTClassifier nt74n57a d82ed9b8-1b58-4c89-ba67-07eeb255e54d -- POST / 200 153.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,062 mnist_classifier_MNISTClassifier nt74n57a 977b9cfc-880f-4aa5-b8ae-9cc62dbe3eb5 -- POST / 200 153.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,063 mnist_classifier_MNISTClassifier nt74n57a 6e30879d-2d61-4fd5-a048-7cb43462a346 -- POST / 200 152.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,063 mnist_classifier_MNISTClassifier nt74n57a 6d702fb7-bc29-4480-a636-dfdeefe65fff -- POST / 200 152.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,063 mnist_classifier_MNISTClassifier nt74n57a 7e3b1d85-bf73-492e-bd04-6f66be7387dc -- POST / 200 150.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,063 mnist_classifier_MNISTClassifier nt74n57a 08b3c315-9bb5-4013-9881-46199b92c93d -- POST / 200 149.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a 8c3b61cd-f703-4508-b5c0-1f91b600e10e -- POST / 200 149.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a 4608d93e-ed24-4c30-919e-d4b504a0cb4d -- POST / 200 149.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a b17922ca-999c-4ac3-9adb-a1755b8d039e -- POST / 200 147.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a b41836c4-f29c-43be-8722-eed0801bbcd9 -- POST / 200 145.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a ca447cc5-6978-48ea-a022-93ceb6425e25 -- POST / 200 144.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,064 mnist_classifier_MNISTClassifier nt74n57a af72ad0c-1d14-4668-8843-66089e92f0da -- POST / 200 144.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,065 mnist_classifier_MNISTClassifier nt74n57a 0ef85bc9-966f-472f-ad43-ea2468733d12 -- POST / 200 144.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,065 mnist_classifier_MNISTClassifier nt74n57a 99816b9e-4129-42ad-82ac-0be575323c78 -- POST / 200 143.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,065 mnist_classifier_MNISTClassifier nt74n57a 6a09ba80-e7b0-4199-a69c-821db87d68c5 -- POST / 200 142.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,065 mnist_classifier_MNISTClassifier nt74n57a 127de38c-ce7f-4d04-b3ef-00abacce6d4e -- POST / 200 141.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,065 mnist_classifier_MNISTClassifier nt74n57a b17dcd8e-4fb4-4c41-a0b2-41cc07fa1f02 -- POST / 200 141.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,465 mnist_classifier_MNISTClassifier nt74n57a 46285f4e-8238-47bf-bb0a-3e64d5000be9 -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,471 mnist_classifier_MNISTClassifier nt74n57a fd2c5c39-d254-454c-b240-5a696e82590b -- POST / 200 405.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,472 mnist_classifier_MNISTClassifier nt74n57a 34dedbfa-d2bb-422b-88e9-391167fb856c -- POST / 200 402.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,473 mnist_classifier_MNISTClassifier nt74n57a 5719dbc5-acd6-4e95-8c84-3a9d0288a6d4 -- POST / 200 403.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,473 mnist_classifier_MNISTClassifier nt74n57a 996e0359-ddd6-4ca4-b59b-d9e993120951 -- POST / 200 342.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,474 mnist_classifier_MNISTClassifier nt74n57a 17bad43a-c77f-4007-8763-48f3602aea3e -- POST / 200 401.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,475 mnist_classifier_MNISTClassifier nt74n57a 2cf8e583-e48e-410b-833c-ffc571586edd -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,475 mnist_classifier_MNISTClassifier nt74n57a b3c63670-cb33-428e-8671-7208e7c199d9 -- POST / 200 399.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,477 mnist_classifier_MNISTClassifier nt74n57a 6ad844d5-cdc6-4b4e-9a3a-0d001e38116b -- POST / 200 399.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,477 mnist_classifier_MNISTClassifier nt74n57a c7f52c11-5739-4dd4-80df-19a97bd3d8e5 -- POST / 200 399.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,478 mnist_classifier_MNISTClassifier nt74n57a eae80f08-749f-4af7-9202-bb8b3e81c2cc -- POST / 200 397.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,479 mnist_classifier_MNISTClassifier nt74n57a 92fe8bb7-cb1b-4d23-ba79-967ba25c870e -- POST / 200 396.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,479 mnist_classifier_MNISTClassifier nt74n57a b77f1499-16b2-472c-b6ed-50ad2cd6b788 -- POST / 200 396.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,480 mnist_classifier_MNISTClassifier nt74n57a c87aa09a-45c3-423b-88ef-c494cf2efbde -- POST / 200 396.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,480 mnist_classifier_MNISTClassifier nt74n57a 87bd3b45-8dff-446f-aedd-d278b1e192c1 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,481 mnist_classifier_MNISTClassifier nt74n57a ad93d661-466d-41e2-b543-a70a748239cb -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,481 mnist_classifier_MNISTClassifier nt74n57a ddafcb18-9274-45f0-a774-20eb0f0da723 -- POST / 200 388.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,483 mnist_classifier_MNISTClassifier nt74n57a e2f7fe49-411f-4e68-934a-058fe8f7cb60 -- POST / 200 384.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,483 mnist_classifier_MNISTClassifier nt74n57a 24ecc0b0-811f-47a8-8883-3c3cfebf654e -- POST / 200 372.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,483 mnist_classifier_MNISTClassifier nt74n57a ce0fdd46-1500-433c-8dfb-189d481b13d2 -- POST / 200 370.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,566 mnist_classifier_MNISTClassifier nt74n57a d110d22e-6294-48a7-a0d2-235032c9553e -- POST / 200 444.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,568 mnist_classifier_MNISTClassifier nt74n57a 0d9a50b5-0e64-4b4e-9b2f-611035007ede -- POST / 200 444.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,568 mnist_classifier_MNISTClassifier nt74n57a ff282a45-04c1-48fb-abc3-b92923a94e97 -- POST / 200 443.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,569 mnist_classifier_MNISTClassifier nt74n57a 55fcd60b-fafd-488f-8e50-1dd363791e6c -- POST / 200 444.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,571 mnist_classifier_MNISTClassifier nt74n57a aca02b3c-c2da-47a8-bb09-495a1290e50d -- POST / 200 443.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,571 mnist_classifier_MNISTClassifier nt74n57a e01aa610-f05b-4e49-9110-054136d9dc91 -- POST / 200 442.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,573 mnist_classifier_MNISTClassifier nt74n57a ac0483dd-6c39-4b37-b68f-1089b4b52e1b -- POST / 200 408.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,573 mnist_classifier_MNISTClassifier nt74n57a f412db40-23b6-4b87-9c15-e2a5948f0d08 -- POST / 200 442.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,583 mnist_classifier_MNISTClassifier nt74n57a 80971441-cfc0-41c4-a484-0bf089db2b6b -- POST / 200 451.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,584 mnist_classifier_MNISTClassifier nt74n57a b9a79597-5916-4243-b651-36b3c18dc8a0 -- POST / 200 452.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,585 mnist_classifier_MNISTClassifier nt74n57a 7514feb3-11bb-4ac5-bbf0-cade9663bea1 -- POST / 200 451.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,586 mnist_classifier_MNISTClassifier nt74n57a 461e4ad6-c2a8-4ca5-87de-d6dc02d9f594 -- POST / 200 449.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,588 mnist_classifier_MNISTClassifier nt74n57a 75a608d9-c525-49c0-9796-a7ffd5a3a3cb -- POST / 200 450.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,589 mnist_classifier_MNISTClassifier nt74n57a aa244c7a-f0fb-492c-906c-36e6ed28abb2 -- POST / 200 452.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,591 mnist_classifier_MNISTClassifier nt74n57a 2f1839fe-ae87-4639-98de-d66d4c5c8e15 -- POST / 200 451.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,592 mnist_classifier_MNISTClassifier nt74n57a 6cd8d376-5ea9-4f0e-bc4b-7c9b84313c63 -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,594 mnist_classifier_MNISTClassifier nt74n57a b0dfae9e-5da1-4a39-a336-7b34af7780bf -- POST / 200 452.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,594 mnist_classifier_MNISTClassifier nt74n57a df6d68bd-eeb9-4785-88aa-9412d6563b5e -- POST / 200 452.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,595 mnist_classifier_MNISTClassifier nt74n57a 4b331362-56ca-4671-a211-b12446ce3c7c -- POST / 200 451.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,595 mnist_classifier_MNISTClassifier nt74n57a 98071204-c348-49eb-a776-72e4db938fa7 -- POST / 200 451.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,595 mnist_classifier_MNISTClassifier nt74n57a 7269ac02-eb2d-4009-946e-48051fec6bfd -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,596 mnist_classifier_MNISTClassifier nt74n57a e459ab56-b2e0-48cf-a200-c1e2df625ff7 -- POST / 200 435.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,598 mnist_classifier_MNISTClassifier nt74n57a ce0e7b70-318d-4b1f-8cce-b8b2282306d5 -- POST / 200 437.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,605 mnist_classifier_MNISTClassifier nt74n57a e8b63ebb-80c1-4ef4-a51d-5af3224628ef -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,606 mnist_classifier_MNISTClassifier nt74n57a 731abdb8-54b6-4f89-b4f1-b339b39b4d10 -- POST / 200 441.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,606 mnist_classifier_MNISTClassifier nt74n57a 55410b23-882c-44d4-8778-e4cdcfe67ef0 -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,607 mnist_classifier_MNISTClassifier nt74n57a f0cde809-9fae-4142-9915-7809385977ae -- POST / 200 427.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,607 mnist_classifier_MNISTClassifier nt74n57a b260a233-2e50-4d95-a58d-31b1c55c5f2d -- POST / 200 425.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,607 mnist_classifier_MNISTClassifier nt74n57a 56311958-d5a4-4f6e-888f-c90f851cb132 -- POST / 200 425.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,608 mnist_classifier_MNISTClassifier nt74n57a 29afff10-1a15-465c-98ee-d84e3813dfd2 -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,608 mnist_classifier_MNISTClassifier nt74n57a 09498a8f-04fa-4e16-9b3f-fd6cee8e8fed -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,608 mnist_classifier_MNISTClassifier nt74n57a 6bdd0b7b-7d1b-497a-944f-bb8ee62675b7 -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,609 mnist_classifier_MNISTClassifier nt74n57a e4e9641e-d06d-4527-9010-c1c644e1b27e -- POST / 200 424.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,610 mnist_classifier_MNISTClassifier nt74n57a 0a9d6eeb-4846-48e6-b953-2d2d5e30e1e7 -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,611 mnist_classifier_MNISTClassifier nt74n57a 588c8690-2432-47a6-a092-945fb6520172 -- POST / 200 423.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,612 mnist_classifier_MNISTClassifier nt74n57a 00a90d58-0bf2-42e1-aa35-5b528697d13b -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,613 mnist_classifier_MNISTClassifier nt74n57a f03fe6ab-13d4-4739-9ae3-c27cdef77297 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,614 mnist_classifier_MNISTClassifier nt74n57a 60c68cc4-8730-4570-848b-3474217b605f -- POST / 200 423.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,614 mnist_classifier_MNISTClassifier nt74n57a 435359e7-59a9-4b2c-83d9-f240d99a0b2f -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,617 mnist_classifier_MNISTClassifier nt74n57a f483d86f-1253-47f8-ba60-a9b37558854a -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,619 mnist_classifier_MNISTClassifier nt74n57a ea3e6f50-c50f-4592-9df5-6f3660b47674 -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,620 mnist_classifier_MNISTClassifier nt74n57a 2d515b7c-5515-401e-8df0-f4be0286d135 -- POST / 200 371.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,624 mnist_classifier_MNISTClassifier nt74n57a 3da245e9-78ed-452d-9e6c-277baf710a01 -- POST / 200 375.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,625 mnist_classifier_MNISTClassifier nt74n57a 44717b28-2882-41d4-8451-9cd70ab3fa31 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,625 mnist_classifier_MNISTClassifier nt74n57a d0eae6fc-2e8b-4667-997a-33939105fab4 -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,625 mnist_classifier_MNISTClassifier nt74n57a 977ebaa6-504f-4f0a-b102-888dbd04928f -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,625 mnist_classifier_MNISTClassifier nt74n57a ecfd5ff0-d707-41cc-a2f4-49b9a66f606c -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,625 mnist_classifier_MNISTClassifier nt74n57a a88f88e4-b5f6-4cfd-aeb4-6237b0adee2d -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,626 mnist_classifier_MNISTClassifier nt74n57a 2717373b-d1c1-4b20-8f6e-c204cca09ce7 -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,626 mnist_classifier_MNISTClassifier nt74n57a fa47303c-623e-460c-a0ae-97d04dc32b84 -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,626 mnist_classifier_MNISTClassifier nt74n57a ac184931-b0de-4aef-8188-00041b5b35b0 -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,689 mnist_classifier_MNISTClassifier nt74n57a fef9497b-8dde-4d63-b36b-d64a8bc326aa -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,692 mnist_classifier_MNISTClassifier nt74n57a c78b753d-99ea-45af-8221-2ae31ae51732 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,693 mnist_classifier_MNISTClassifier nt74n57a e694a4df-6493-46f9-ab03-211fc3305352 -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,697 mnist_classifier_MNISTClassifier nt74n57a 2f36d88b-2186-41ef-ad92-b69154dd82f9 -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,697 mnist_classifier_MNISTClassifier nt74n57a b767af24-72c9-4031-857f-b8d3f7ee077e -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,701 mnist_classifier_MNISTClassifier nt74n57a b91e3840-79d8-4a58-a4d7-c82cb12c1261 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,703 mnist_classifier_MNISTClassifier nt74n57a f1e57231-4913-40da-b159-e500eadf3b2e -- POST / 200 294.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,704 mnist_classifier_MNISTClassifier nt74n57a c8b5017c-16b7-4c17-82a7-dabe5f1f81a2 -- POST / 200 293.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,706 mnist_classifier_MNISTClassifier nt74n57a 17fcfbf4-b346-49fb-9b75-31e66fbc092f -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,709 mnist_classifier_MNISTClassifier nt74n57a 1a3e25ee-1432-4719-a606-c9f52337109d -- POST / 200 298.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,710 mnist_classifier_MNISTClassifier nt74n57a cc8d9371-71dd-4e55-ac6d-c4f5e66c3222 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,711 mnist_classifier_MNISTClassifier nt74n57a 872a2ba5-4979-4f08-8e60-0c997dae5999 -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,713 mnist_classifier_MNISTClassifier nt74n57a 1215aee5-0830-4929-a078-081bb7a82208 -- POST / 200 298.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,716 mnist_classifier_MNISTClassifier nt74n57a 70aa2726-32d1-4a35-8bcb-fce1ca416775 -- POST / 200 299.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,720 mnist_classifier_MNISTClassifier nt74n57a fab7691c-55b4-4677-9048-c1271d9f6fa9 -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,720 mnist_classifier_MNISTClassifier nt74n57a 9d00f028-a9b9-4cc9-a901-a7ecac015e24 -- POST / 200 306.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,720 mnist_classifier_MNISTClassifier nt74n57a a6007b3d-2502-49b0-9ed8-d57960d8fa97 -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,721 mnist_classifier_MNISTClassifier nt74n57a 1798d1aa-f1d4-44c5-b49d-a44ca3b4f237 -- POST / 200 304.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,721 mnist_classifier_MNISTClassifier nt74n57a 9767c9f2-cd18-49dc-9cdd-5133b39a5405 -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,721 mnist_classifier_MNISTClassifier nt74n57a 2c1b17fd-5fdf-4862-95a0-35836f76d8e2 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,721 mnist_classifier_MNISTClassifier nt74n57a 2526ac17-c0c9-4d90-a080-50eefa5f3bde -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,722 mnist_classifier_MNISTClassifier nt74n57a db9c3ce6-a443-4a63-80c4-4704fb0a1b11 -- POST / 200 301.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,722 mnist_classifier_MNISTClassifier nt74n57a 08a312d3-2a24-4b39-bfba-622bdef6e114 -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,723 mnist_classifier_MNISTClassifier nt74n57a 1e609b59-a898-4f61-88f8-d757172c6337 -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,723 mnist_classifier_MNISTClassifier nt74n57a 5aecb775-b9ae-4643-aa2e-d2c23c4e2223 -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,723 mnist_classifier_MNISTClassifier nt74n57a 5cdc1055-3b4d-4101-9b39-ff11036f4912 -- POST / 200 299.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,723 mnist_classifier_MNISTClassifier nt74n57a 724bed70-69dc-47ef-85c6-78bd98aa2bb7 -- POST / 200 298.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,724 mnist_classifier_MNISTClassifier nt74n57a 9c40a17f-1db5-432a-aeba-45c24e4ab92f -- POST / 200 299.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,725 mnist_classifier_MNISTClassifier nt74n57a 114c5547-ed39-48c6-9ee8-de22bef04b79 -- POST / 200 299.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,726 mnist_classifier_MNISTClassifier nt74n57a b62bfa86-fb8a-4888-93ef-3d75f0c7cbcc -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,726 mnist_classifier_MNISTClassifier nt74n57a bdef3139-e896-45fa-a0db-47b92ab3161d -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,727 mnist_classifier_MNISTClassifier nt74n57a 14c87d68-8502-48b5-886a-2d3ee189ecd9 -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,728 mnist_classifier_MNISTClassifier nt74n57a 7fedac94-5cfc-4389-a58f-dc363a31d92d -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,728 mnist_classifier_MNISTClassifier nt74n57a 367e4cd0-c356-407b-8357-2b3d2941c631 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,729 mnist_classifier_MNISTClassifier nt74n57a 77ff9b94-4cd7-4685-9c3f-8a715c36bda3 -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,729 mnist_classifier_MNISTClassifier nt74n57a 82fcb73f-921e-4adf-b932-3ec17055a53a -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,731 mnist_classifier_MNISTClassifier nt74n57a 37e08559-f25b-417d-9d04-bc9b8413b01a -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,732 mnist_classifier_MNISTClassifier nt74n57a 34b138d4-a97f-4a1e-9d82-1ed844fa6407 -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,734 mnist_classifier_MNISTClassifier nt74n57a 75eeb619-54b2-44be-a5b6-20fe33153e78 -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,735 mnist_classifier_MNISTClassifier nt74n57a 49fe7049-7e9c-41c6-9143-5c8682ba1b4a -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,738 mnist_classifier_MNISTClassifier nt74n57a d7f54e1e-a68b-4593-9547-c69dcaf8abaa -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,742 mnist_classifier_MNISTClassifier nt74n57a 954a4235-63c9-4f0a-a2d5-16a7e85f2cbb -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,744 mnist_classifier_MNISTClassifier nt74n57a 4a259ab5-af99-452d-9406-5ef3c4e7e2f7 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,745 mnist_classifier_MNISTClassifier nt74n57a a19d65e5-16c0-4c44-be88-742e79c17326 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,746 mnist_classifier_MNISTClassifier nt74n57a 8be4d9a8-af06-4bb5-9386-fb55415ac59c -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,748 mnist_classifier_MNISTClassifier nt74n57a 719112f8-4c08-40c0-894d-efeb350eb037 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,749 mnist_classifier_MNISTClassifier nt74n57a 1dcc0311-8d6b-4a00-835b-a45a32772554 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,750 mnist_classifier_MNISTClassifier nt74n57a 7bee50ec-ee20-4d11-946c-0b7ffdecc8f5 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,751 mnist_classifier_MNISTClassifier nt74n57a 0732696b-791a-4058-82d6-b8a6355d1691 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,854 mnist_classifier_MNISTClassifier nt74n57a 4a55de07-619c-4126-8d7d-a7b6680b933b -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,856 mnist_classifier_MNISTClassifier nt74n57a 8d30401e-6064-4d66-927a-0c2057530886 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,861 mnist_classifier_MNISTClassifier nt74n57a 911f1e37-97aa-43a6-a191-f1e919ddb84a -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,863 mnist_classifier_MNISTClassifier nt74n57a d1022cb2-ab86-4131-8f31-59a0fbef92f8 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,864 mnist_classifier_MNISTClassifier nt74n57a 26e9c363-914c-454c-b68e-6ff463ce98eb -- POST / 200 298.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,865 mnist_classifier_MNISTClassifier nt74n57a a031e985-5370-4eae-bc45-198e8b45b7a5 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,866 mnist_classifier_MNISTClassifier nt74n57a 2b478a0a-3049-4398-81ae-88136535efa3 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,868 mnist_classifier_MNISTClassifier nt74n57a c688cc95-a5fb-45a4-a309-cab72904343b -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,870 mnist_classifier_MNISTClassifier nt74n57a 231d9f07-7fea-4b5a-9a55-af827387d837 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,872 mnist_classifier_MNISTClassifier nt74n57a 92e1f9d1-607e-46e4-8cf4-f2903a236e23 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,872 mnist_classifier_MNISTClassifier nt74n57a fd4c285e-c897-4e0e-9244-922f22e0ce31 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,873 mnist_classifier_MNISTClassifier nt74n57a bbc8a130-a812-4d86-9936-ea19fb1e0b33 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,874 mnist_classifier_MNISTClassifier nt74n57a a9506225-d8d8-452c-aff2-c0266732ee4b -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,875 mnist_classifier_MNISTClassifier nt74n57a 62d4eb84-aee2-4206-b834-de61b5bfa47c -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,876 mnist_classifier_MNISTClassifier nt74n57a f3793fdb-95ac-4677-b8c5-03f79f9cd858 -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,877 mnist_classifier_MNISTClassifier nt74n57a e7d61aff-dfb5-436b-830b-ee29b2512540 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,877 mnist_classifier_MNISTClassifier nt74n57a 2f201e8c-3a8a-4d36-9876-67bede8e9f8a -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,877 mnist_classifier_MNISTClassifier nt74n57a 8d235a84-7445-4dd2-bc88-df0e34c91695 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,878 mnist_classifier_MNISTClassifier nt74n57a a227f8fa-b618-4ca4-ab96-eec64034f25b -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,879 mnist_classifier_MNISTClassifier nt74n57a cfb1ddb9-06ca-4540-b8be-03c966eeec71 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,880 mnist_classifier_MNISTClassifier nt74n57a 32cb7071-3db1-453d-8388-461b3f04c2b9 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,889 mnist_classifier_MNISTClassifier nt74n57a bef96af2-2a19-4127-a315-2782417540d2 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,892 mnist_classifier_MNISTClassifier nt74n57a bcc25c26-da92-4f75-b502-bc72f6a995b8 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,893 mnist_classifier_MNISTClassifier nt74n57a af424ade-c24d-4430-9650-ffacb22f2a45 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,893 mnist_classifier_MNISTClassifier nt74n57a 8eefd074-08da-4c97-a9e9-5b767dbcab94 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,900 mnist_classifier_MNISTClassifier nt74n57a 0e131ff4-878c-404c-b5c2-8efe9bb35f34 -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,901 mnist_classifier_MNISTClassifier nt74n57a 2e4b6270-28b3-4de3-8394-1aa3f702789a -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,902 mnist_classifier_MNISTClassifier nt74n57a d1298de1-c0b4-4ec1-aa14-338419fcacad -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,903 mnist_classifier_MNISTClassifier nt74n57a e252e75b-2744-4cba-b6f8-761806e760a6 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,904 mnist_classifier_MNISTClassifier nt74n57a 540f09a2-1ed5-4bdb-a2c7-c9ff0a86a371 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,905 mnist_classifier_MNISTClassifier nt74n57a 1c370497-7cda-477b-aea0-528c62e1602a -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,906 mnist_classifier_MNISTClassifier nt74n57a 6ac18591-8b61-4893-962f-ff3d4098ce04 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,908 mnist_classifier_MNISTClassifier nt74n57a a777f1b7-9dd5-4ef6-bf91-4f4de2563d5d -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,910 mnist_classifier_MNISTClassifier nt74n57a 89d7fc37-144d-4596-bf62-d36f4d750141 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,913 mnist_classifier_MNISTClassifier nt74n57a c4254606-efec-405c-9024-a47cfab58ed4 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,916 mnist_classifier_MNISTClassifier nt74n57a 5857e82e-f299-4331-af2f-515a09800524 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,917 mnist_classifier_MNISTClassifier nt74n57a 8e5e0648-235f-4c88-8ab8-7995640c884b -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,917 mnist_classifier_MNISTClassifier nt74n57a 1ac172db-135b-40f7-ad3f-9a960f9b3b51 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,917 mnist_classifier_MNISTClassifier nt74n57a 43e4da12-c4da-4205-8687-c76a3b3c3319 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,918 mnist_classifier_MNISTClassifier nt74n57a 4ad28fa9-ab5e-47cb-8669-55cb9dd6e6e1 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:03,918 mnist_classifier_MNISTClassifier nt74n57a e0a5b6fe-d264-451a-8e25-e4b84ae40260 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,017 mnist_classifier_MNISTClassifier nt74n57a 0881bb28-16d7-408a-b646-13d55be8710a -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,023 mnist_classifier_MNISTClassifier nt74n57a 93a4af88-e498-470a-9ec3-90d3dead0b7e -- POST / 200 316.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,025 mnist_classifier_MNISTClassifier nt74n57a d7f243f6-cd00-49fa-8906-76bf0410ac24 -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,025 mnist_classifier_MNISTClassifier nt74n57a 38c561c3-db9a-44d5-a718-c5fda4d714ef -- POST / 200 342.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,026 mnist_classifier_MNISTClassifier nt74n57a 661a827c-b83a-4453-8e83-715266681c46 -- POST / 200 342.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,029 mnist_classifier_MNISTClassifier nt74n57a fa018d30-0c3e-46b3-bf9c-5d7091dcfc58 -- POST / 200 344.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,029 mnist_classifier_MNISTClassifier nt74n57a 27b65cf2-d568-4c43-b5c7-d2d598943640 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,030 mnist_classifier_MNISTClassifier nt74n57a f24d8fe0-6c0c-4de6-9332-01dfe1b0b6e0 -- POST / 200 342.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,031 mnist_classifier_MNISTClassifier nt74n57a a8a4a67c-3695-43ae-a83c-b9597ef384e4 -- POST / 200 294.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,031 mnist_classifier_MNISTClassifier nt74n57a 87207019-5c7f-4ec3-b01e-eddfb424f189 -- POST / 200 323.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,033 mnist_classifier_MNISTClassifier nt74n57a 616d762d-1d42-44b9-a5a8-a79195e8c085 -- POST / 200 324.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,034 mnist_classifier_MNISTClassifier nt74n57a 74edb02f-16ed-4a6e-9acf-8170c2c00b03 -- POST / 200 282.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,036 mnist_classifier_MNISTClassifier nt74n57a f7e81759-b0e1-4e1e-a3ab-1c32697146bf -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,038 mnist_classifier_MNISTClassifier nt74n57a 0bb0fd75-bd62-47e1-b1cb-c636b14041dd -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,038 mnist_classifier_MNISTClassifier nt74n57a 0ea45a02-3d21-4a6e-903a-f1b963a422ad -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,038 mnist_classifier_MNISTClassifier nt74n57a f0ce229b-bb4a-4224-bf99-c6c093f2ce38 -- POST / 200 272.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,038 mnist_classifier_MNISTClassifier nt74n57a 6117d9bf-6c0f-44ac-bbb9-b9663c15ec69 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,042 mnist_classifier_MNISTClassifier nt74n57a c0367fee-1ae9-4328-b768-5eb4e0777d9c -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,049 mnist_classifier_MNISTClassifier nt74n57a b5c3c8ad-2e25-4d9e-a315-766b8c1957ed -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,052 mnist_classifier_MNISTClassifier nt74n57a 5e1a4e0d-2a2e-47cf-a572-f91a5ae37484 -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,053 mnist_classifier_MNISTClassifier nt74n57a 0f15b117-e61c-4288-9e2b-6eb5996145e6 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,057 mnist_classifier_MNISTClassifier nt74n57a a5730318-eaea-429b-aa47-c227a5b0259a -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,060 mnist_classifier_MNISTClassifier nt74n57a c1059382-1c6f-479b-b2d5-9614b7fac67f -- POST / 200 285.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,060 mnist_classifier_MNISTClassifier nt74n57a 2d941cd8-543e-4cae-a759-5f8c431cc211 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,061 mnist_classifier_MNISTClassifier nt74n57a 2d437084-08b8-4ef4-8aa0-750c46b04bca -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,062 mnist_classifier_MNISTClassifier nt74n57a 78ace608-625a-4305-af5c-3ccf9c53411e -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,062 mnist_classifier_MNISTClassifier nt74n57a 7fc73916-4724-4803-b004-adb0b0c0005e -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,063 mnist_classifier_MNISTClassifier nt74n57a dc2c73ac-a6bf-4d32-9ca6-cd80f2503fcf -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,063 mnist_classifier_MNISTClassifier nt74n57a e20f6532-9427-4006-8db6-0aa223e813e9 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,064 mnist_classifier_MNISTClassifier nt74n57a 3f000c10-de08-4696-80b8-425cdfa94477 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,064 mnist_classifier_MNISTClassifier nt74n57a d4e4f316-1278-42c1-bffa-c84ae19dfd5c -- POST / 200 280.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,064 mnist_classifier_MNISTClassifier nt74n57a 20001a6f-2b29-403b-a836-72d81c28bebe -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,068 mnist_classifier_MNISTClassifier nt74n57a c91ded22-82de-496e-96f5-985c88a9fb4b -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,069 mnist_classifier_MNISTClassifier nt74n57a 1dab5df6-a5e7-4153-9e18-5055a83cbfd7 -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,071 mnist_classifier_MNISTClassifier nt74n57a e6e46f32-4e4b-4e77-a7d0-230a992ca2e0 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,071 mnist_classifier_MNISTClassifier nt74n57a 54328e12-da53-46fb-abd4-a61a0310864c -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,071 mnist_classifier_MNISTClassifier nt74n57a c04e6cea-d229-4158-bd5d-75cb89b33808 -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,072 mnist_classifier_MNISTClassifier nt74n57a 22f9471e-edf2-4166-bbdf-9dc0527aed63 -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,072 mnist_classifier_MNISTClassifier nt74n57a 09e95a80-00cb-4f01-9b98-f398eb586f13 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,072 mnist_classifier_MNISTClassifier nt74n57a d66fc955-5f49-4cb8-87db-b96c685a61b3 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,072 mnist_classifier_MNISTClassifier nt74n57a 70b7e44c-838b-4285-84f4-5f5edccf22e5 -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,073 mnist_classifier_MNISTClassifier nt74n57a 0fa225af-76b8-4848-9df8-938d58f5150a -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,140 mnist_classifier_MNISTClassifier nt74n57a 66e59e9f-44b8-4a0d-9ef1-c83db0367c06 -- POST / 200 325.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,141 mnist_classifier_MNISTClassifier nt74n57a dc02a445-379d-4b60-8e4d-c042c0c9a9de -- POST / 200 326.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,142 mnist_classifier_MNISTClassifier nt74n57a 36c93f9c-fd5d-4f5e-aa7b-f7807b2c1f43 -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,144 mnist_classifier_MNISTClassifier nt74n57a 4987dfee-6586-4b33-a58c-c4a828fc339a -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,147 mnist_classifier_MNISTClassifier nt74n57a 4e27e998-85f5-4bf3-becd-d2a851a0e4c9 -- POST / 200 330.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,150 mnist_classifier_MNISTClassifier nt74n57a f5588481-0a1d-4aff-9cc4-61f5e3b64d60 -- POST / 200 333.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,153 mnist_classifier_MNISTClassifier nt74n57a 3749720f-f6fd-4802-a291-24d4609bf363 -- POST / 200 336.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,157 mnist_classifier_MNISTClassifier nt74n57a 6b8bddfe-c72d-49ed-9028-31da48ae509d -- POST / 200 335.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,157 mnist_classifier_MNISTClassifier nt74n57a cd3982f8-d3a4-4664-8e00-1cb1f0e725f1 -- POST / 200 335.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,157 mnist_classifier_MNISTClassifier nt74n57a 83d7e2d0-fc5a-4751-b695-819ddf21ef80 -- POST / 200 324.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,157 mnist_classifier_MNISTClassifier nt74n57a 25a5640b-89a9-44d4-af6d-44e49f57f5b1 -- POST / 200 336.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,158 mnist_classifier_MNISTClassifier nt74n57a 46f26d0e-df86-46b4-9b70-f795931fc3fb -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,159 mnist_classifier_MNISTClassifier nt74n57a 39871fec-c0e4-477a-ba0f-ef7a764fe58b -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,159 mnist_classifier_MNISTClassifier nt74n57a db93340c-76bb-4364-b345-e2e784031228 -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,159 mnist_classifier_MNISTClassifier nt74n57a 636071bb-1f04-4169-882b-767552d7329f -- POST / 200 303.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,163 mnist_classifier_MNISTClassifier nt74n57a 97e9ed48-9f52-4a31-95aa-d897d30f83c9 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,164 mnist_classifier_MNISTClassifier nt74n57a ee442f5f-75ca-4540-bf3e-4a1c22ac4636 -- POST / 200 291.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,164 mnist_classifier_MNISTClassifier nt74n57a 28b60a15-9f1b-430f-b8b4-40ede0e08ffe -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,164 mnist_classifier_MNISTClassifier nt74n57a 2c0024d6-f597-43d0-ba61-b0c88b3eb2cb -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,165 mnist_classifier_MNISTClassifier nt74n57a 84f1bcbd-a3eb-4de3-82f1-c70eb793d04f -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,166 mnist_classifier_MNISTClassifier nt74n57a 8b4b033d-e15b-4703-b745-9402e714e8a4 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,168 mnist_classifier_MNISTClassifier nt74n57a 7dc47ce4-513e-456d-ab7b-6014e53d1723 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,169 mnist_classifier_MNISTClassifier nt74n57a b694f709-6201-4f92-8c3a-e36ae1928282 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,170 mnist_classifier_MNISTClassifier nt74n57a fb7fa3fe-957a-4d60-bf82-c2c71d6a44e0 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,171 mnist_classifier_MNISTClassifier nt74n57a 68f666c2-2e76-48ef-8384-63fba8b3f829 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,172 mnist_classifier_MNISTClassifier nt74n57a 9be33ae6-44b1-4e33-897f-a6c519f7e4d6 -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,172 mnist_classifier_MNISTClassifier nt74n57a 3f7ba06f-a68b-431b-899d-1426477f9a54 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,173 mnist_classifier_MNISTClassifier nt74n57a a3bd8c23-31ef-42be-b072-6d8219076df0 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,174 mnist_classifier_MNISTClassifier nt74n57a 94f0cca3-1a26-48f3-88ee-401fd9ad30a8 -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,174 mnist_classifier_MNISTClassifier nt74n57a fea96742-7212-4a7c-a00e-18c23a474f93 -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,174 mnist_classifier_MNISTClassifier nt74n57a 92cfd897-ef55-43ab-b8ba-7081b12e9f7c -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,174 mnist_classifier_MNISTClassifier nt74n57a a6ef5eb4-d630-4f6d-89ac-f1c45b2de152 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,174 mnist_classifier_MNISTClassifier nt74n57a e377bf34-c5f0-470a-a909-1508eda8caec -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a 34e66f08-f8e8-4455-bf0d-b2379d3b90b1 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a 0a3acf2b-dc48-43f9-9703-5824f19cda9f -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a 3f89ea4b-bf2d-42df-8ada-931a6d85b290 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a 68d70530-2493-4c29-b297-a44b8f3b6e8e -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a e295ee20-e9d0-49a2-824c-abd4b16ec8b0 -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,175 mnist_classifier_MNISTClassifier nt74n57a 4498dd57-ae14-474c-b137-1f5d6c82dac1 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a f656654e-d974-4e78-9d1d-ebd76c8e2632 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a 0bac69ef-5ad9-4d9e-a39b-f99501667d37 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a 5d5e3eb9-b3f8-4a37-8ec0-1240060fb3c3 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a d430921a-b303-4cd5-b317-20573b2f9a51 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a 30659489-3ef5-4462-90ed-1b6b7e9ea3cb -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a 7801017b-9467-4f1e-aea4-009855bb8665 -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,176 mnist_classifier_MNISTClassifier nt74n57a eac2107a-1a8b-49ba-a953-022c3d6fbb5a -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,213 mnist_classifier_MNISTClassifier nt74n57a ddaa2010-0ec8-461c-96d2-b2bb1caf605d -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,237 mnist_classifier_MNISTClassifier nt74n57a 894adfde-5e64-4dd7-8d4b-5d30486b4347 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,238 mnist_classifier_MNISTClassifier nt74n57a 510a817d-0e39-4088-b239-337946fcdfc0 -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,238 mnist_classifier_MNISTClassifier nt74n57a cddd668e-bda7-4652-84f0-d52b72df63f9 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,238 mnist_classifier_MNISTClassifier nt74n57a 787bf1cf-70c2-45a0-a471-0772c8037b90 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a 1a7853f2-d817-4044-8163-6f8d25aa7e26 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a d3d8b352-1b78-467b-ad8a-67b9d7837dbf -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a f89c2950-0d27-431c-8f6f-4b95242d479a -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a 6e51cd14-687d-44d5-a25a-423b392441d5 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a ca55106d-1478-48dd-b9d3-92527f59f80b -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a fd05f241-0254-41f1-9354-37e1c773b312 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,239 mnist_classifier_MNISTClassifier nt74n57a 810223f6-1973-4392-a564-b3325541b719 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,240 mnist_classifier_MNISTClassifier nt74n57a 56158e24-e0c5-4591-8d95-8e5d85f7dc75 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,240 mnist_classifier_MNISTClassifier nt74n57a f057bf46-4bd4-4f7f-9583-1e926f2c5119 -- POST / 200 202.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,240 mnist_classifier_MNISTClassifier nt74n57a 69ec84a2-1647-4d2b-a22a-22139a3b1d1b -- POST / 200 172.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,240 mnist_classifier_MNISTClassifier nt74n57a 3a52996b-c1e1-4017-b5a5-7fddb0cb0a1b -- POST / 200 178.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,240 mnist_classifier_MNISTClassifier nt74n57a 2f543d60-d73b-4356-8784-c22325c23471 -- POST / 200 172.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,464 mnist_classifier_MNISTClassifier nt74n57a d5000bf8-e125-4d30-828d-5d34d379962f -- POST / 200 378.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,466 mnist_classifier_MNISTClassifier nt74n57a 1c803294-0a39-4575-8eb1-5b81b45c9667 -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,466 mnist_classifier_MNISTClassifier nt74n57a 8935e5ed-3bdc-4292-8282-69785e4ac199 -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,466 mnist_classifier_MNISTClassifier nt74n57a 74ee70c1-de61-44c3-a8d9-301c2d66977a -- POST / 200 380.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,466 mnist_classifier_MNISTClassifier nt74n57a 4e5a71e7-4559-4c21-b0e9-093e45ee9438 -- POST / 200 379.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,467 mnist_classifier_MNISTClassifier nt74n57a fcfdf323-8432-454c-b025-22e51dfd063c -- POST / 200 377.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,467 mnist_classifier_MNISTClassifier nt74n57a 338b51cd-92be-4139-9557-e932e61c5d87 -- POST / 200 378.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,468 mnist_classifier_MNISTClassifier nt74n57a 91c8ef22-cb52-4257-9162-b630d23a480e -- POST / 200 378.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,637 mnist_classifier_MNISTClassifier nt74n57a 58640338-8f2b-4bca-863c-a189f966c3ad -- POST / 200 545.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,638 mnist_classifier_MNISTClassifier nt74n57a c82718d5-7790-4b5e-985a-809ff7c20900 -- POST / 200 544.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,638 mnist_classifier_MNISTClassifier nt74n57a 5e4394be-e3a3-4a56-9de3-1f8eacd60793 -- POST / 200 543.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,639 mnist_classifier_MNISTClassifier nt74n57a 11dba759-9fb6-48d1-9c1f-7f001c970c79 -- POST / 200 543.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,639 mnist_classifier_MNISTClassifier nt74n57a 6abe849b-d5a2-4eab-8f0a-3716a7869e16 -- POST / 200 544.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,640 mnist_classifier_MNISTClassifier nt74n57a c5a081cd-a83e-40d8-abdf-18f3f5380ec1 -- POST / 200 540.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,641 mnist_classifier_MNISTClassifier nt74n57a daf8ed6a-ba06-42d6-a0b4-d9827c37e27b -- POST / 200 540.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,641 mnist_classifier_MNISTClassifier nt74n57a 822f8fb7-bc8e-4446-8868-ea5861e85f58 -- POST / 200 540.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,642 mnist_classifier_MNISTClassifier nt74n57a b596fee0-1014-4925-97ab-f7063c0f3e57 -- POST / 200 540.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,644 mnist_classifier_MNISTClassifier nt74n57a 6b05ce0a-9f73-4066-bb69-aeb6b0fd12a6 -- POST / 200 541.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,645 mnist_classifier_MNISTClassifier nt74n57a 9ac77983-5ac2-4c48-ad64-ce82cf13f1e6 -- POST / 200 540.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,645 mnist_classifier_MNISTClassifier nt74n57a 55cecff4-490e-4d11-b150-879c4741c239 -- POST / 200 540.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,645 mnist_classifier_MNISTClassifier nt74n57a ffc82e7c-faa9-45ba-a454-0ebe2999f908 -- POST / 200 540.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,645 mnist_classifier_MNISTClassifier nt74n57a 33e38bed-83b6-41df-aa63-667402c96396 -- POST / 200 540.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,646 mnist_classifier_MNISTClassifier nt74n57a a162c1b1-57e5-4f1f-b8ff-100399706527 -- POST / 200 540.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,646 mnist_classifier_MNISTClassifier nt74n57a 46212fc9-e268-4114-a984-d250517a00fd -- POST / 200 496.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,646 mnist_classifier_MNISTClassifier nt74n57a a11595ef-f94a-4de3-88b3-f550dc19de63 -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,646 mnist_classifier_MNISTClassifier nt74n57a d30ce0ef-58e2-40e5-a41e-86be8385afff -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,647 mnist_classifier_MNISTClassifier nt74n57a eaf3f990-b8fa-43fb-86f8-ccffb480ebe6 -- POST / 200 540.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,647 mnist_classifier_MNISTClassifier nt74n57a 7a6ea73f-edaf-4bb0-9225-028517fa7a61 -- POST / 200 539.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,647 mnist_classifier_MNISTClassifier nt74n57a 9700697b-33bc-4ee9-9a3a-3395c1d0b53b -- POST / 200 534.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,648 mnist_classifier_MNISTClassifier nt74n57a 8b1e499e-8e21-4500-8f1c-4944b0d92b0c -- POST / 200 511.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,648 mnist_classifier_MNISTClassifier nt74n57a 0c307619-c9c2-44c8-a68f-eaf856f276cd -- POST / 200 512.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,650 mnist_classifier_MNISTClassifier nt74n57a e823cfc6-b573-43dc-bde8-bae5f9913d1b -- POST / 200 513.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,650 mnist_classifier_MNISTClassifier nt74n57a 06e6d179-0733-402e-955d-622d2d3bd6ad -- POST / 200 513.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,651 mnist_classifier_MNISTClassifier nt74n57a 839a3723-02b2-437f-ad04-7b35c61ac4c3 -- POST / 200 514.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,651 mnist_classifier_MNISTClassifier nt74n57a a847fed0-777e-4342-8473-ce2a32bb2912 -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,652 mnist_classifier_MNISTClassifier nt74n57a 3bf321dc-0bac-402a-b48b-4a7df1e1beb1 -- POST / 200 514.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,654 mnist_classifier_MNISTClassifier nt74n57a 6d081a01-ff1f-48c1-8a19-c0f88fa691ef -- POST / 200 511.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,654 mnist_classifier_MNISTClassifier nt74n57a 7a22ae37-901d-46b1-ac9d-866322d5cb11 -- POST / 200 476.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,655 mnist_classifier_MNISTClassifier nt74n57a 7caeeb5e-1710-469c-8158-841c3ed17806 -- POST / 200 477.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,655 mnist_classifier_MNISTClassifier nt74n57a 6c5fb393-4869-4364-af4e-90b31b4624d5 -- POST / 200 475.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,655 mnist_classifier_MNISTClassifier nt74n57a 2876d889-2abc-47c2-b47b-bcb10e84a383 -- POST / 200 472.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,656 mnist_classifier_MNISTClassifier nt74n57a e7d9590a-56cb-49e7-8a65-e10723fd6805 -- POST / 200 471.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,656 mnist_classifier_MNISTClassifier nt74n57a 345666a7-fb18-42cb-b720-7185590726c5 -- POST / 200 470.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,656 mnist_classifier_MNISTClassifier nt74n57a 4fb72d86-fc83-4360-bade-7d40a9ec6925 -- POST / 200 469.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,657 mnist_classifier_MNISTClassifier nt74n57a 249e7582-7c6a-456f-ab77-8cbe37404f0c -- POST / 200 467.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,657 mnist_classifier_MNISTClassifier nt74n57a 931d2288-fe81-4e08-aff8-2f3c2e4bfa0a -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,657 mnist_classifier_MNISTClassifier nt74n57a d7a8c60d-de94-4f4f-b643-ba978add1b95 -- POST / 200 467.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,657 mnist_classifier_MNISTClassifier nt74n57a 31c22405-cef7-4612-aaf1-1e96e743644e -- POST / 200 465.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,658 mnist_classifier_MNISTClassifier nt74n57a 43adb533-a2aa-44f8-85d3-ed87a1e3df56 -- POST / 200 465.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,658 mnist_classifier_MNISTClassifier nt74n57a c0828b94-8e57-4407-afd0-e76c32661f87 -- POST / 200 465.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,658 mnist_classifier_MNISTClassifier nt74n57a a84d5036-82be-4680-8a0d-d2b646d97e2a -- POST / 200 452.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,658 mnist_classifier_MNISTClassifier nt74n57a 0bb4b07d-f514-4117-9427-8e74406b1dd1 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,659 mnist_classifier_MNISTClassifier nt74n57a 42720f33-9ed4-4b55-bfb8-7253853de7f2 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,659 mnist_classifier_MNISTClassifier nt74n57a 070f4efe-43ce-4d65-bd6a-d0aed9fdef55 -- POST / 200 417.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,659 mnist_classifier_MNISTClassifier nt74n57a 5756a39c-f416-4a8f-9981-6d57e0e92beb -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,659 mnist_classifier_MNISTClassifier nt74n57a 1467e08e-27b2-4e9c-aeeb-36d2f9b8bf95 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,660 mnist_classifier_MNISTClassifier nt74n57a 8c8ed10b-d351-4d03-bf5d-8aec6cacc5a4 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,660 mnist_classifier_MNISTClassifier nt74n57a 96f89d84-8dda-4914-8a40-fb18cdd3c5fb -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,660 mnist_classifier_MNISTClassifier nt74n57a 74e1b9c7-1907-4f4c-aa6c-7ff195bab7ef -- POST / 200 415.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,660 mnist_classifier_MNISTClassifier nt74n57a 1d40bd29-84d0-480c-8f17-f7edf371ad08 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,661 mnist_classifier_MNISTClassifier nt74n57a 9fda2134-66c2-4f36-832b-ccf687f11b16 -- POST / 200 415.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,661 mnist_classifier_MNISTClassifier nt74n57a 92369907-daf1-4cea-b95d-6ec490d9bbab -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,661 mnist_classifier_MNISTClassifier nt74n57a 8269ec5c-f27d-41c4-b5b8-07de2f2e3711 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,661 mnist_classifier_MNISTClassifier nt74n57a 3b9cd5da-e0b9-4e0f-b6b2-4690f8ca94bd -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,662 mnist_classifier_MNISTClassifier nt74n57a 35878253-c6d5-4bfd-8449-7c687960949a -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,662 mnist_classifier_MNISTClassifier nt74n57a 2e8c73e6-4fb4-4eb9-a9dd-150cc1d07cc9 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,662 mnist_classifier_MNISTClassifier nt74n57a 0d7c4cc0-7f44-4195-8540-fa516c48b502 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,662 mnist_classifier_MNISTClassifier nt74n57a 5b78ff8b-0467-48a0-b7ea-5a2d11ae198d -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,663 mnist_classifier_MNISTClassifier nt74n57a 7f80a330-33ba-4e94-a9c4-24acd5e5da56 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,663 mnist_classifier_MNISTClassifier nt74n57a ac8c1b98-71ff-4834-8118-188cf8d0c2a0 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,664 mnist_classifier_MNISTClassifier nt74n57a e53eb15d-3ce0-4b14-8cea-d6740f2bdccd -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,664 mnist_classifier_MNISTClassifier nt74n57a 8a410c96-5c48-4a36-96f9-1ec7550b2eb9 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,664 mnist_classifier_MNISTClassifier nt74n57a d96bc697-951f-47e0-8a19-0f7034c6c83b -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,664 mnist_classifier_MNISTClassifier nt74n57a 9a8db60b-ebf5-4872-8260-ae789695cc15 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,665 mnist_classifier_MNISTClassifier nt74n57a 2fe940e1-1e82-4bd7-9a57-57b94ed1e635 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,665 mnist_classifier_MNISTClassifier nt74n57a e79f9399-54c0-4d81-a597-4a2f8ddf8a90 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,666 mnist_classifier_MNISTClassifier nt74n57a 200b6cb0-983d-4b7a-ab43-cc5d268e6828 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,666 mnist_classifier_MNISTClassifier nt74n57a 0e3da08f-c5b2-4c39-8482-618f985334b2 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,666 mnist_classifier_MNISTClassifier nt74n57a 27f9e2c4-1a8b-496c-aad4-9194d679930d -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,666 mnist_classifier_MNISTClassifier nt74n57a c6f1d400-7096-46b6-a6b9-049cb910e8ed -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,667 mnist_classifier_MNISTClassifier nt74n57a 91a2f153-18be-4f0f-a2f9-d61138ad98e8 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,667 mnist_classifier_MNISTClassifier nt74n57a 9e1dd83d-6efd-4a61-92fc-f3df146d1baf -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,668 mnist_classifier_MNISTClassifier nt74n57a 42705be2-baa0-4d21-abe7-4c78c292a301 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,668 mnist_classifier_MNISTClassifier nt74n57a 48f36110-cad1-460d-8638-a265741ac6bb -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,674 mnist_classifier_MNISTClassifier nt74n57a 8420802f-2ab3-43ba-be5d-d1925b7d61e7 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,680 mnist_classifier_MNISTClassifier nt74n57a a7a2055d-2142-43e7-8a44-d875d44fe1d3 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,680 mnist_classifier_MNISTClassifier nt74n57a b8f64ddf-4679-4414-8c57-2be31ed4d65e -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,680 mnist_classifier_MNISTClassifier nt74n57a b9dbe882-26aa-4772-909b-e11bb54acec0 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,682 mnist_classifier_MNISTClassifier nt74n57a 7c3bf816-536e-4894-84da-8d5cc8722991 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,682 mnist_classifier_MNISTClassifier nt74n57a b666fec9-54fb-4e4b-9ff9-30fdbf0c5f13 -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,683 mnist_classifier_MNISTClassifier nt74n57a e0e66cce-bf79-4e7c-a81d-74a78aaa1ca8 -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,684 mnist_classifier_MNISTClassifier nt74n57a b0126f05-aef0-4da3-aa13-a8f2d1040a5b -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,685 mnist_classifier_MNISTClassifier nt74n57a 3ace8761-9843-4fb1-abeb-1b20a2096e57 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,685 mnist_classifier_MNISTClassifier nt74n57a 98729ffc-2575-4d15-a7f8-579db53ecb7d -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,685 mnist_classifier_MNISTClassifier nt74n57a 0a4d16cb-0b89-4612-9db8-f48c2c234034 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,685 mnist_classifier_MNISTClassifier nt74n57a 8159f8dc-7540-412b-b851-14df8dbe496f -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,685 mnist_classifier_MNISTClassifier nt74n57a c38d579a-cb38-4c52-9828-f5a93ee28e62 -- POST / 200 254.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,686 mnist_classifier_MNISTClassifier nt74n57a 649e8d80-9090-453a-9985-c17121d5b17b -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,687 mnist_classifier_MNISTClassifier nt74n57a e882dd14-583f-40ac-8397-ffdb1f60f111 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,688 mnist_classifier_MNISTClassifier nt74n57a 065eef81-9dc6-481b-92a3-7a9ff819cf93 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,694 mnist_classifier_MNISTClassifier nt74n57a 0f9d5dd6-5761-40d8-ae1b-330b657618e3 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,695 mnist_classifier_MNISTClassifier nt74n57a 1ba86ac8-d077-42ac-8023-052bea83c821 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,695 mnist_classifier_MNISTClassifier nt74n57a 8c2b3fd0-baa7-4008-87d4-c7b55a40d9e3 -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,695 mnist_classifier_MNISTClassifier nt74n57a b7de861e-6620-4318-b29f-37ae6459b1d1 -- POST / 200 225.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,696 mnist_classifier_MNISTClassifier nt74n57a 5ec87406-4ce7-46a9-a896-0a4f2d7748a5 -- POST / 200 215.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,696 mnist_classifier_MNISTClassifier nt74n57a e48fbf2e-ae81-43bf-aa82-a24c2449e8dd -- POST / 200 215.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,696 mnist_classifier_MNISTClassifier nt74n57a afbbbec3-ff6b-4e99-8d9d-aac029ec56b9 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,697 mnist_classifier_MNISTClassifier nt74n57a 9e871ddd-a639-4148-869c-292d2c31bc8b -- POST / 200 212.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,946 mnist_classifier_MNISTClassifier nt74n57a c4b8748d-51af-412d-b922-58cf3eca2561 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,948 mnist_classifier_MNISTClassifier nt74n57a 49d618c6-d58a-4e67-80de-6970899b5b17 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,948 mnist_classifier_MNISTClassifier nt74n57a ef8b8ef5-4753-4440-b23c-131b28f1246c -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,949 mnist_classifier_MNISTClassifier nt74n57a 446a1c12-8d0e-4636-9426-50ef407f7c9b -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,952 mnist_classifier_MNISTClassifier nt74n57a 8eef3bb9-0ff5-4f76-af4d-55d37e6ea728 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,952 mnist_classifier_MNISTClassifier nt74n57a ff538cf9-80e8-42ad-9145-3ee2752e2a9e -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,953 mnist_classifier_MNISTClassifier nt74n57a 644dcde1-9b2e-4917-850d-b0aa3fe60e84 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,954 mnist_classifier_MNISTClassifier nt74n57a 4020a5d0-3398-4a29-8f5f-af07ed14484e -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,963 mnist_classifier_MNISTClassifier nt74n57a 3653b80d-d9d3-4f9a-8b96-514c8107fa65 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,964 mnist_classifier_MNISTClassifier nt74n57a e3dc49f6-fa5b-400c-b660-41922f7796b5 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,965 mnist_classifier_MNISTClassifier nt74n57a 405ad66c-8f2e-4f2b-a846-bbb970c58e28 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,965 mnist_classifier_MNISTClassifier nt74n57a 4c285571-888e-414b-80df-f44456e431ec -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,968 mnist_classifier_MNISTClassifier nt74n57a fef9af69-0cd8-4065-a80b-69e1f93400f4 -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,969 mnist_classifier_MNISTClassifier nt74n57a 86f7acc7-2c85-4f75-9661-ffd30c7e8b81 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,970 mnist_classifier_MNISTClassifier nt74n57a 077bce83-06d0-4ce9-83e9-1cd774b1e5e2 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,971 mnist_classifier_MNISTClassifier nt74n57a 52d65674-aea5-4939-8eae-2151f6749994 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,971 mnist_classifier_MNISTClassifier nt74n57a 065c0ed2-4bcd-4c4e-8f72-c165d53aa3a6 -- POST / 200 254.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,971 mnist_classifier_MNISTClassifier nt74n57a 968c0249-0b98-4253-b3d1-32c617a700d2 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,972 mnist_classifier_MNISTClassifier nt74n57a d6793d78-4260-488a-ad75-da19482b679b -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,973 mnist_classifier_MNISTClassifier nt74n57a 82c12777-72b1-4750-a97f-9973e12c1156 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,974 mnist_classifier_MNISTClassifier nt74n57a 1833f830-5553-486d-8f62-4e6534f73b94 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,975 mnist_classifier_MNISTClassifier nt74n57a bb4c43c7-c874-4bba-95f8-2fa20ff9ac2e -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,975 mnist_classifier_MNISTClassifier nt74n57a 3afdbca1-e9a5-455e-92d9-9a63b0df3d8f -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,975 mnist_classifier_MNISTClassifier nt74n57a 869d1b4a-f66f-4914-bd7e-7cc729c3cae2 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,976 mnist_classifier_MNISTClassifier nt74n57a 5e197087-2924-45e6-8204-b1b2483db9b8 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,976 mnist_classifier_MNISTClassifier nt74n57a 138a1def-ed0d-4091-99af-a7819c5d49d8 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,976 mnist_classifier_MNISTClassifier nt74n57a dd80bd93-7dbc-492d-8693-0eee5bd7ece2 -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,976 mnist_classifier_MNISTClassifier nt74n57a 9aeed22c-501b-42c2-9cc0-13b117479081 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,977 mnist_classifier_MNISTClassifier nt74n57a f314cca5-eee1-4d83-88c7-81ac3da4329d -- POST / 200 214.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,977 mnist_classifier_MNISTClassifier nt74n57a 41df67aa-2915-443d-8603-40b773b591e0 -- POST / 200 214.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,979 mnist_classifier_MNISTClassifier nt74n57a 9e61b136-2d0d-49fd-94a2-3efa37e12d06 -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,980 mnist_classifier_MNISTClassifier nt74n57a 533d47c6-5a47-4e33-b279-875d90fc4c3f -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,981 mnist_classifier_MNISTClassifier nt74n57a b2d22aad-22f9-42af-b4a2-cb3d8a1da7dd -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,983 mnist_classifier_MNISTClassifier nt74n57a 1b09f39b-56c3-4218-8c14-7d35cadcdeb8 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,987 mnist_classifier_MNISTClassifier nt74n57a 10c17208-545b-47dd-a071-3656ae960986 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,988 mnist_classifier_MNISTClassifier nt74n57a b7af8e96-d5e0-439b-9cf8-4795b5ae8bfd -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:04,989 mnist_classifier_MNISTClassifier nt74n57a 8a10bdb9-121d-4a34-ac2a-cdaf93e83fb6 -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,062 mnist_classifier_MNISTClassifier nt74n57a 335b8f77-c094-4cef-8fe3-ceaf904198cc -- POST / 200 280.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,063 mnist_classifier_MNISTClassifier nt74n57a c719c1fa-68c3-41d3-9205-4bbb9434c54b -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,063 mnist_classifier_MNISTClassifier nt74n57a ecee3045-8432-4739-989a-64e5b1abf36d -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,064 mnist_classifier_MNISTClassifier nt74n57a d43d8492-f609-4106-905a-e0b05672dc1f -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,064 mnist_classifier_MNISTClassifier nt74n57a e5764b13-ac57-44d5-aa7c-59f9fc6566a5 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,065 mnist_classifier_MNISTClassifier nt74n57a 426f29d7-15cf-49cc-b344-81b35c8e468c -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,066 mnist_classifier_MNISTClassifier nt74n57a a03a9779-c0bf-4da7-907a-0ba67fe1d805 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,067 mnist_classifier_MNISTClassifier nt74n57a fefa97fa-577a-420c-9eac-fe6f41c3561c -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,069 mnist_classifier_MNISTClassifier nt74n57a 8d15012c-444a-4b47-8002-dc1b249ee082 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,070 mnist_classifier_MNISTClassifier nt74n57a ebabfd34-21e4-4ae2-9544-11ee1a6c10c9 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,073 mnist_classifier_MNISTClassifier nt74n57a 090cedab-2b5e-4079-82e3-21f8e3ee3732 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,075 mnist_classifier_MNISTClassifier nt74n57a 533a12a3-50a8-458d-b8b4-0930b088feb5 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,076 mnist_classifier_MNISTClassifier nt74n57a a19c4187-a4f2-463e-9fa3-35140f284fb0 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,077 mnist_classifier_MNISTClassifier nt74n57a cd3347b2-c205-4efb-ab5d-2e4a20858ac9 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,078 mnist_classifier_MNISTClassifier nt74n57a 88cbda65-300b-4c49-83a0-7a18becc12fd -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,079 mnist_classifier_MNISTClassifier nt74n57a 8781fd1a-8b58-4e6c-9f87-367cfb5d0cc5 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,079 mnist_classifier_MNISTClassifier nt74n57a 27508061-81a1-4c94-8297-ebb30722cceb -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,079 mnist_classifier_MNISTClassifier nt74n57a 52cdb64a-c0e5-47db-b34c-22ef8a31063f -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,080 mnist_classifier_MNISTClassifier nt74n57a df840628-5096-4f22-bee2-2f08f6806c22 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,081 mnist_classifier_MNISTClassifier nt74n57a 3e66834e-39e8-47dd-9358-3246ad313b63 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,082 mnist_classifier_MNISTClassifier nt74n57a e0de7c5d-8c8b-4f03-8218-281d688b297e -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,083 mnist_classifier_MNISTClassifier nt74n57a 1efb0f3a-ed54-4912-9fc3-5045a65be6a7 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,084 mnist_classifier_MNISTClassifier nt74n57a 3becb791-4962-4d1e-ad5e-d2c37b176281 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,084 mnist_classifier_MNISTClassifier nt74n57a 12718f14-575e-4c61-b71a-bd2989a19adc -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,085 mnist_classifier_MNISTClassifier nt74n57a 70d0a0d7-4d9b-4d73-b6a3-b93cf125ed60 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,085 mnist_classifier_MNISTClassifier nt74n57a d5f86437-ad4e-43fb-ad13-5a9441bea106 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,087 mnist_classifier_MNISTClassifier nt74n57a f02867ce-42e6-4f7a-8091-35a2a3a34235 -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,088 mnist_classifier_MNISTClassifier nt74n57a a8f9fec5-7270-4a74-85a3-727323920322 -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,088 mnist_classifier_MNISTClassifier nt74n57a a25a982d-d65e-4941-9d3b-cd761021cd29 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,095 mnist_classifier_MNISTClassifier nt74n57a 39bd219f-9bf5-483d-a423-afbc3761ce4f -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,096 mnist_classifier_MNISTClassifier nt74n57a 351db4bb-677c-4629-9a1b-ae91b41369a3 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,099 mnist_classifier_MNISTClassifier nt74n57a 0ceff6c6-068d-491c-afe3-f919433a16bc -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,099 mnist_classifier_MNISTClassifier nt74n57a bb7b28c5-fb79-4f49-82dc-05bef6ecc93b -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,101 mnist_classifier_MNISTClassifier nt74n57a b333ad51-6bd4-44a4-b7d3-03c9a132d4d5 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,101 mnist_classifier_MNISTClassifier nt74n57a c9d27763-60e3-45b2-a385-516e775c182d -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,102 mnist_classifier_MNISTClassifier nt74n57a 2d5adf6e-c2fd-4902-bbe0-59ef399598b5 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,105 mnist_classifier_MNISTClassifier nt74n57a 6108e604-29d1-4937-b773-9da8748a4fc4 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,109 mnist_classifier_MNISTClassifier nt74n57a f56d413b-a22e-4670-8106-42e64f1db0aa -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,109 mnist_classifier_MNISTClassifier nt74n57a 7c3594ed-db53-49b2-89e7-7e2e8c85fe81 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,110 mnist_classifier_MNISTClassifier nt74n57a 4d172c03-9600-4f0a-909d-16dec875b83c -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,110 mnist_classifier_MNISTClassifier nt74n57a 5c749799-a357-4025-9c06-c58bcead19fc -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,110 mnist_classifier_MNISTClassifier nt74n57a edf9786a-5c62-4cd9-9572-02edd3c5f622 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,113 mnist_classifier_MNISTClassifier nt74n57a 394f43dd-44cc-4f0a-b25b-ed557f7cb38d -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,117 mnist_classifier_MNISTClassifier nt74n57a 782d8821-a12b-486b-ab3d-6eaa3293afac -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,119 mnist_classifier_MNISTClassifier nt74n57a 67f676a0-9ced-4718-afd5-7243abc23f64 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,120 mnist_classifier_MNISTClassifier nt74n57a cc72b3c9-1eb1-458f-bc48-0432b0f1403a -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,120 mnist_classifier_MNISTClassifier nt74n57a a91b6f6c-27f8-4177-ae90-b3e2bbba6487 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,121 mnist_classifier_MNISTClassifier nt74n57a e894c422-cfaf-4770-a6c6-4eb12f2817f1 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,121 mnist_classifier_MNISTClassifier nt74n57a 4c91220d-2065-4d08-93bd-751f8a5495b3 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,125 mnist_classifier_MNISTClassifier nt74n57a 4ada36f5-c02a-487a-b11c-8db1723dcabf -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,125 mnist_classifier_MNISTClassifier nt74n57a 9096c43a-dfaa-4e0b-9816-a292352dc006 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,126 mnist_classifier_MNISTClassifier nt74n57a 3cf4b2f1-c062-4d30-8ce0-05a1c33040e2 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,126 mnist_classifier_MNISTClassifier nt74n57a a377f4d9-904d-4be6-9a00-2a2717fe5a42 -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,397 mnist_classifier_MNISTClassifier nt74n57a ea3f5fd9-bafa-4e5e-91b7-7de2755571b7 -- POST / 200 517.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,399 mnist_classifier_MNISTClassifier nt74n57a acf9d49a-66ac-4693-860f-314e1547a6d5 -- POST / 200 517.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,399 mnist_classifier_MNISTClassifier nt74n57a 2396e554-0aee-44c5-9e31-e3bc4341ce85 -- POST / 200 530.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,402 mnist_classifier_MNISTClassifier nt74n57a 3ba70c04-c162-457a-8b12-a7e27ce1b638 -- POST / 200 533.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,407 mnist_classifier_MNISTClassifier nt74n57a ca2bfbd0-b242-45da-85fc-a6ed6158dcb1 -- POST / 200 537.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,409 mnist_classifier_MNISTClassifier nt74n57a 3fc2a399-d0cd-4ec5-96b0-87ebb1b82873 -- POST / 200 538.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,420 mnist_classifier_MNISTClassifier nt74n57a fefd2948-6a52-4834-a3f6-6b969d3f0132 -- POST / 200 544.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,433 mnist_classifier_MNISTClassifier nt74n57a ca113f3f-17e1-4be4-9d65-313214000490 -- POST / 200 554.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,434 mnist_classifier_MNISTClassifier nt74n57a 588ad0ec-c78b-4874-8277-f049fe86124f -- POST / 200 555.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,434 mnist_classifier_MNISTClassifier nt74n57a e0c3c044-8a6c-4cf7-a27a-9befe6894686 -- POST / 200 555.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,434 mnist_classifier_MNISTClassifier nt74n57a 8a07bcf9-be14-487c-9c7d-237f5e185a68 -- POST / 200 456.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,435 mnist_classifier_MNISTClassifier nt74n57a 27349541-490e-4429-addd-152265005641 -- POST / 200 456.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,436 mnist_classifier_MNISTClassifier nt74n57a 9374433f-e57d-45e0-9528-ef116c46cd30 -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,436 mnist_classifier_MNISTClassifier nt74n57a 945d6654-1bf3-4168-a6fd-7738908525e6 -- POST / 200 453.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,436 mnist_classifier_MNISTClassifier nt74n57a 01e6358a-eaa2-470c-bbaa-18faaa17ab0f -- POST / 200 441.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,437 mnist_classifier_MNISTClassifier nt74n57a ee6a073b-63ef-4373-b6b2-d144db86f2b2 -- POST / 200 441.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,437 mnist_classifier_MNISTClassifier nt74n57a 81fcf4af-960a-454f-a9c9-2aec226cccd8 -- POST / 200 440.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,437 mnist_classifier_MNISTClassifier nt74n57a aa24848a-d1fc-4d34-9d5e-1ecf3c55b6cd -- POST / 200 432.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a 1d669ab0-4d4d-40d8-bf60-c8ba4b9cf39a -- POST / 200 433.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a 8086f10c-3fcf-4606-9a1e-89356a5efd50 -- POST / 200 439.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a 78a990fd-0af4-40db-9f1a-381541007d96 -- POST / 200 438.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a 05c09427-f724-47ea-b27f-bee7ea680a36 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a b1497824-8e3c-46f2-8a3e-b88aae568eaa -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,438 mnist_classifier_MNISTClassifier nt74n57a 3aae07ab-9533-4394-9e30-ac8d99a55fcc -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,439 mnist_classifier_MNISTClassifier nt74n57a 9990b272-78dd-473c-a38d-cc134803a4af -- POST / 200 424.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,439 mnist_classifier_MNISTClassifier nt74n57a 28d0f550-999e-4fb0-81ad-55332fb0c5c9 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,439 mnist_classifier_MNISTClassifier nt74n57a ce37358c-9374-4f5d-ba4c-738b85f09209 -- POST / 200 424.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,439 mnist_classifier_MNISTClassifier nt74n57a 24ee4be1-39e9-43fd-99b8-84720a280331 -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,440 mnist_classifier_MNISTClassifier nt74n57a b01870a3-7093-4c5a-a82b-5cb06fd28ce8 -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,440 mnist_classifier_MNISTClassifier nt74n57a 4c08fdc5-aa17-4e54-9080-7d74b4e8a680 -- POST / 200 424.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,440 mnist_classifier_MNISTClassifier nt74n57a 98b78ad6-ea62-41ec-b148-0a8efaf838d8 -- POST / 200 423.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,568 mnist_classifier_MNISTClassifier nt74n57a f1e3041d-4b51-43aa-b6f2-41d50a85a3a8 -- POST / 200 547.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,569 mnist_classifier_MNISTClassifier nt74n57a 7c115092-fd66-4451-a3d1-ce4626740a7b -- POST / 200 547.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,569 mnist_classifier_MNISTClassifier nt74n57a 9e37e18b-510f-4e16-a811-983adaafb51d -- POST / 200 547.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,570 mnist_classifier_MNISTClassifier nt74n57a 4c219288-1688-4d91-afba-a4515a2c3780 -- POST / 200 539.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,571 mnist_classifier_MNISTClassifier nt74n57a e5846c82-e6c6-4f90-8229-de963d0ea363 -- POST / 200 547.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,571 mnist_classifier_MNISTClassifier nt74n57a 7c436ef3-9d3f-42fa-91b7-c4b052bc047b -- POST / 200 539.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,572 mnist_classifier_MNISTClassifier nt74n57a 2973f66a-df4b-4e67-98f6-33d7422388f6 -- POST / 200 529.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,572 mnist_classifier_MNISTClassifier nt74n57a 3195b697-0bd4-4cef-9f61-6824b51a2bda -- POST / 200 547.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,572 mnist_classifier_MNISTClassifier nt74n57a d1475839-cd8f-40ab-8d54-de4c0e645532 -- POST / 200 547.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,573 mnist_classifier_MNISTClassifier nt74n57a bbb285c1-92f0-492c-9341-c4b7a8e4e340 -- POST / 200 547.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,574 mnist_classifier_MNISTClassifier nt74n57a 3620bcc2-894a-487c-a174-889a373e8819 -- POST / 200 541.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,575 mnist_classifier_MNISTClassifier nt74n57a 1d07deb3-9bec-42f4-8683-2c356b2632b9 -- POST / 200 533.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,577 mnist_classifier_MNISTClassifier nt74n57a c56abe87-a2eb-41da-ad21-e748839a5da0 -- POST / 200 524.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,578 mnist_classifier_MNISTClassifier nt74n57a 9712cf0b-9b1b-4acc-a7cd-5d475338302c -- POST / 200 524.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,578 mnist_classifier_MNISTClassifier nt74n57a 99d7dc48-2e82-4fcc-b725-7a3d4e734005 -- POST / 200 522.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,579 mnist_classifier_MNISTClassifier nt74n57a b02f05aa-918d-4ba1-a1d5-c17fcbdf9737 -- POST / 200 521.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,580 mnist_classifier_MNISTClassifier nt74n57a 4045f22f-feb0-467f-806c-6d09166fbcea -- POST / 200 463.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,581 mnist_classifier_MNISTClassifier nt74n57a 86557777-1498-43c3-9ccd-fa19975d1cd5 -- POST / 200 454.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,581 mnist_classifier_MNISTClassifier nt74n57a 78da4b32-6b98-4a16-94b3-10a9cac28909 -- POST / 200 454.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,581 mnist_classifier_MNISTClassifier nt74n57a b8b1e7c7-1a3f-48ec-a06b-1ca6c008737d -- POST / 200 451.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,581 mnist_classifier_MNISTClassifier nt74n57a de4be1a6-34e3-4869-870d-25f9ff203076 -- POST / 200 449.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,582 mnist_classifier_MNISTClassifier nt74n57a ca40c074-59c9-4adb-81b4-4cac31d2440f -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,582 mnist_classifier_MNISTClassifier nt74n57a 479bf31b-0595-4411-b8a9-15b5a0762d61 -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,582 mnist_classifier_MNISTClassifier nt74n57a 2053bca8-3249-401f-aaec-10b4b188b5b5 -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,586 mnist_classifier_MNISTClassifier nt74n57a 7cf932a2-48d8-42db-8273-010c6f07aa86 -- POST / 200 450.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,587 mnist_classifier_MNISTClassifier nt74n57a a1c237d7-7ab5-43ab-afe6-fdd95ad8dfc0 -- POST / 200 449.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,587 mnist_classifier_MNISTClassifier nt74n57a 2569d734-2b5a-43de-a15b-c33d3c22eede -- POST / 200 448.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,589 mnist_classifier_MNISTClassifier nt74n57a 66992e1b-0d73-4393-ac24-b81a89f17bd4 -- POST / 200 450.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,590 mnist_classifier_MNISTClassifier nt74n57a 92a8f448-753d-4453-ba45-b19bb67bd134 -- POST / 200 449.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,591 mnist_classifier_MNISTClassifier nt74n57a 8ef429f8-7700-495d-b92b-ce313ec82c80 -- POST / 200 448.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,591 mnist_classifier_MNISTClassifier nt74n57a 0c149bb7-7e1a-42e4-a8c1-b80284e1b69f -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,592 mnist_classifier_MNISTClassifier nt74n57a ffa3c6af-f3d5-493b-9a5a-645f3f9b3122 -- POST / 200 448.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,593 mnist_classifier_MNISTClassifier nt74n57a 40f5320c-be0e-4ff4-a47d-c6aa23c0a4a9 -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,593 mnist_classifier_MNISTClassifier nt74n57a 092efaec-eeac-4b46-9307-13d9341b44dc -- POST / 200 447.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,595 mnist_classifier_MNISTClassifier nt74n57a 48a21096-ce7b-4212-85a5-89bc702a1a2c -- POST / 200 448.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,595 mnist_classifier_MNISTClassifier nt74n57a fa054ca8-b66b-4427-995d-146c2283d442 -- POST / 200 448.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,596 mnist_classifier_MNISTClassifier nt74n57a dfdce2b2-ad79-4f0e-b980-3e85c2e38201 -- POST / 200 448.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,596 mnist_classifier_MNISTClassifier nt74n57a ba8d9f2e-6986-453c-a82c-b0267e169d9d -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,597 mnist_classifier_MNISTClassifier nt74n57a 0f0d9737-15c0-4a87-a1d8-2bc79b991fdf -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,597 mnist_classifier_MNISTClassifier nt74n57a 94b25f45-19f4-4d9d-a052-65e1796be0ce -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,597 mnist_classifier_MNISTClassifier nt74n57a aaa6cbe4-5af3-4380-aaae-f6f38d2fad51 -- POST / 200 448.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,597 mnist_classifier_MNISTClassifier nt74n57a a370854d-ed35-4402-894c-8da3c622d531 -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,597 mnist_classifier_MNISTClassifier nt74n57a 0aff2fdf-96dc-4cb6-9276-0769dcd5b3a6 -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a 9e226fe3-1f91-412f-b250-7a022053e1bd -- POST / 200 436.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a b8b7c378-91ba-483b-8966-d3347e072408 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a 986d1379-0bef-46d5-8cf0-b40bb4b3d17f -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a 0ce9907f-a288-4c21-a5a5-c5bb9e57e387 -- POST / 200 430.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a ad21b8e9-40e4-4193-8a3b-aaba1d6c295a -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,598 mnist_classifier_MNISTClassifier nt74n57a f78017e7-e80c-4fcb-b91e-c87c30a33642 -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a d02ec4b5-13e4-49ee-b588-c91457099b6a -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a 824374a7-7e14-4917-86ae-52b332e287c3 -- POST / 200 422.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a a72e559f-cfdd-4146-8472-abdafe3e56bb -- POST / 200 421.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a b1be0f7d-6749-47f4-910d-b170aeed1a6a -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a 5d6fc153-0aae-4e2e-a959-ecf8c728e234 -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,599 mnist_classifier_MNISTClassifier nt74n57a 26b740b8-e870-495d-9860-162e6c7045b3 -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,600 mnist_classifier_MNISTClassifier nt74n57a 5e64b86b-d4b7-43e8-b73b-8169e6640d6f -- POST / 200 419.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,600 mnist_classifier_MNISTClassifier nt74n57a ebe67bf6-de2e-4c1b-9148-e43f0f527996 -- POST / 200 418.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,600 mnist_classifier_MNISTClassifier nt74n57a 111fce91-dfc5-4357-a8df-5329886ddc97 -- POST / 200 417.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,600 mnist_classifier_MNISTClassifier nt74n57a 4441088b-5bc9-4b03-b7f2-c614a46ed35d -- POST / 200 150.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,601 mnist_classifier_MNISTClassifier nt74n57a 00bf9639-d80b-4635-9c6e-8965b7d534af -- POST / 200 416.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,601 mnist_classifier_MNISTClassifier nt74n57a 89ed5492-6794-43a2-ba07-e2af6cbc0126 -- POST / 200 412.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,601 mnist_classifier_MNISTClassifier nt74n57a 94b264a8-5f00-4274-a163-8b8088280110 -- POST / 200 408.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,602 mnist_classifier_MNISTClassifier nt74n57a d2d5af2a-a9cf-4381-9bbf-0d3462eaca5f -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,602 mnist_classifier_MNISTClassifier nt74n57a 060590bb-8f73-40ab-a70c-233e972b2761 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,602 mnist_classifier_MNISTClassifier nt74n57a 2d04f162-5f15-4e33-9426-3c0188200c0e -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,602 mnist_classifier_MNISTClassifier nt74n57a d8b93481-03c8-4e20-bdd9-8e1de959b086 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,605 mnist_classifier_MNISTClassifier nt74n57a 98e8304e-e935-459b-b4ba-f8cf44c81e65 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,605 mnist_classifier_MNISTClassifier nt74n57a a2bd6427-3b6e-40a7-88ed-4ac6db3716aa -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,606 mnist_classifier_MNISTClassifier nt74n57a 9e1ff63e-ebde-4dcb-be1f-cc51db332d88 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,609 mnist_classifier_MNISTClassifier nt74n57a 56347d6a-ebd2-45d2-a6c5-93c40f0b81c4 -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,610 mnist_classifier_MNISTClassifier nt74n57a 303ea371-8dd0-477c-9a61-f555155404ed -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,611 mnist_classifier_MNISTClassifier nt74n57a 70ec928c-ebfc-4a1c-af34-17d952112fa2 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,611 mnist_classifier_MNISTClassifier nt74n57a f61d21f3-95fa-4a0a-8743-f2a492d97d46 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,611 mnist_classifier_MNISTClassifier nt74n57a 18dfb415-4b51-4cbf-a5e9-b6ba7bcf8745 -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,612 mnist_classifier_MNISTClassifier nt74n57a 29fadfeb-6f0e-4984-b77f-3031301920af -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,612 mnist_classifier_MNISTClassifier nt74n57a 183706f1-442b-4572-9d5b-e2392819b65d -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,612 mnist_classifier_MNISTClassifier nt74n57a 5c75150e-fc70-4043-988a-f2b0fd8057d2 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,613 mnist_classifier_MNISTClassifier nt74n57a 55571703-68f6-48ce-a9b8-f077943e3153 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,613 mnist_classifier_MNISTClassifier nt74n57a d38270e9-c403-4c83-b332-c1ee628edaaf -- POST / 200 171.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,613 mnist_classifier_MNISTClassifier nt74n57a c71a674f-38e7-4ec3-8c32-eb01f0db5e41 -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,614 mnist_classifier_MNISTClassifier nt74n57a 0963a199-a744-403c-aef9-9d7a9b4098ee -- POST / 200 166.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,614 mnist_classifier_MNISTClassifier nt74n57a b3660439-a496-4213-a20c-cf495ec46237 -- POST / 200 166.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,615 mnist_classifier_MNISTClassifier nt74n57a 2c1fd97e-170b-4554-8fcc-fdfdfeddd77b -- POST / 200 165.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,615 mnist_classifier_MNISTClassifier nt74n57a dbe74ad0-4086-4c04-9fe5-108cddf31c9b -- POST / 200 164.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,615 mnist_classifier_MNISTClassifier nt74n57a 954056f4-3d0d-4682-b4ee-28e2a81382fd -- POST / 200 163.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,616 mnist_classifier_MNISTClassifier nt74n57a b5dccc55-fa35-496f-8db6-c15abdf3a70d -- POST / 200 162.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,616 mnist_classifier_MNISTClassifier nt74n57a 5bf3371d-543a-4843-aa77-64ae703e4f13 -- POST / 200 161.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,616 mnist_classifier_MNISTClassifier nt74n57a ea4ff156-53d3-4b16-bba1-d8f8d2f8e53c -- POST / 200 161.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,616 mnist_classifier_MNISTClassifier nt74n57a bace7e51-eb1d-40dd-8b30-02efe10ef2e4 -- POST / 200 161.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,617 mnist_classifier_MNISTClassifier nt74n57a ea2a0178-4c25-436e-9493-4efb586321e4 -- POST / 200 161.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,618 mnist_classifier_MNISTClassifier nt74n57a 9c6bde09-2341-4429-90b9-0d86af9b03a4 -- POST / 200 161.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,618 mnist_classifier_MNISTClassifier nt74n57a afadb208-b5b6-40a9-8d28-7ab3972949db -- POST / 200 159.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,619 mnist_classifier_MNISTClassifier nt74n57a 420c6b01-dabe-407e-8a2f-2b03317d6874 -- POST / 200 159.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,619 mnist_classifier_MNISTClassifier nt74n57a 3bb03859-fbdf-407e-ba69-4e68514a87db -- POST / 200 159.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,620 mnist_classifier_MNISTClassifier nt74n57a cfd6a177-6689-4bd6-8bd2-70eb857c0a81 -- POST / 200 160.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,620 mnist_classifier_MNISTClassifier nt74n57a df1229fe-731d-46b5-8dd5-b0c7f581b955 -- POST / 200 137.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,621 mnist_classifier_MNISTClassifier nt74n57a 252e0f74-45fc-48fd-9b8a-0239e65f747c -- POST / 200 140.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,621 mnist_classifier_MNISTClassifier nt74n57a f40ac021-8b75-4bf4-a75d-5e4b9cfe9f25 -- POST / 200 137.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,623 mnist_classifier_MNISTClassifier nt74n57a dcb8fdef-6659-42b8-9853-53b4fcb7b112 -- POST / 200 140.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,623 mnist_classifier_MNISTClassifier nt74n57a 53be150b-30ba-4cd4-80d8-4662109d89d5 -- POST / 200 135.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,831 mnist_classifier_MNISTClassifier nt74n57a b6a74b9a-4036-4bec-ae18-ecd4fc7bcaf1 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,833 mnist_classifier_MNISTClassifier nt74n57a c14b37ca-3d43-4943-bad5-126b419b80d5 -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,833 mnist_classifier_MNISTClassifier nt74n57a b46a3c12-af0b-467b-9304-1d8335c0d6ab -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,835 mnist_classifier_MNISTClassifier nt74n57a 8d41b490-2a78-4b64-b229-7f2b0eefda37 -- POST / 200 201.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,836 mnist_classifier_MNISTClassifier nt74n57a 970421eb-0fff-4cd2-9f83-fe1f0ce51145 -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,838 mnist_classifier_MNISTClassifier nt74n57a 433aa427-f8d5-4200-ba24-6250b637931b -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,838 mnist_classifier_MNISTClassifier nt74n57a 888b08ef-ee08-4453-bff8-509156be4146 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,839 mnist_classifier_MNISTClassifier nt74n57a 26d47251-d82b-4ff2-95c2-1a5a2309f865 -- POST / 200 201.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,843 mnist_classifier_MNISTClassifier nt74n57a 457bbdd2-336f-423c-9a35-4d7d770ce006 -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,843 mnist_classifier_MNISTClassifier nt74n57a c782d7ae-53f6-4ef0-9a53-f7f829c0de91 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,844 mnist_classifier_MNISTClassifier nt74n57a e6acc529-e6f6-4f3d-b7dc-147ae98f2588 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,846 mnist_classifier_MNISTClassifier nt74n57a 9c5b8c34-1fb1-41e5-8f8b-eb059ef7e84e -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,848 mnist_classifier_MNISTClassifier nt74n57a 94884065-72bf-4a9b-88a8-bc06bdc2430d -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,849 mnist_classifier_MNISTClassifier nt74n57a f3a15cb2-6bce-491d-8411-e9fd04848c37 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,850 mnist_classifier_MNISTClassifier nt74n57a f539179e-1d55-41f2-9b52-d97f7bbd15c2 -- POST / 200 204.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,850 mnist_classifier_MNISTClassifier nt74n57a a6b5f1a6-90ff-48f0-97dc-2741228509aa -- POST / 200 205.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,957 mnist_classifier_MNISTClassifier nt74n57a bc9c6d1b-b517-49d5-9988-ae0d6f43d82c -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,958 mnist_classifier_MNISTClassifier nt74n57a bfcf2f32-7efd-4115-abc1-3fe7d4058cb1 -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,959 mnist_classifier_MNISTClassifier nt74n57a 8c23e7a8-e96e-48d0-89cc-3a5d942bfd55 -- POST / 200 313.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,959 mnist_classifier_MNISTClassifier nt74n57a 5553ad53-770b-4c79-94cf-fcfffcf204e9 -- POST / 200 310.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,960 mnist_classifier_MNISTClassifier nt74n57a 16f8f2f4-f7e2-43ac-8641-866ecfbbbee0 -- POST / 200 309.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,961 mnist_classifier_MNISTClassifier nt74n57a 0179a3d0-d26b-4fc6-b690-05c4f13da05f -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,962 mnist_classifier_MNISTClassifier nt74n57a bc83ca82-8a5b-4905-a32a-508b7e06c880 -- POST / 200 312.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,963 mnist_classifier_MNISTClassifier nt74n57a 2e974c15-6cab-4007-9d3d-2e55cf010f02 -- POST / 200 300.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,964 mnist_classifier_MNISTClassifier nt74n57a 814a833f-286b-424e-bc0a-d35953443588 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,965 mnist_classifier_MNISTClassifier nt74n57a f0ceae34-fee4-4c3e-ad06-c66a084550fd -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,966 mnist_classifier_MNISTClassifier nt74n57a 9878d36d-dd03-4295-88c1-6d508a242e5e -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,966 mnist_classifier_MNISTClassifier nt74n57a ea13dc8b-89eb-4bd5-8908-1dcdd196e38f -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,966 mnist_classifier_MNISTClassifier nt74n57a 0a797d73-ccaf-4c03-8226-12809aaa8fbc -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,967 mnist_classifier_MNISTClassifier nt74n57a b54a2d40-de72-49e7-a947-e90c6b0a6d1d -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,967 mnist_classifier_MNISTClassifier nt74n57a 9e521a1d-4920-4caf-bd61-936550ecbcbf -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,968 mnist_classifier_MNISTClassifier nt74n57a 42ffb920-66f5-4ad8-85b1-14ef1eef697b -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,968 mnist_classifier_MNISTClassifier nt74n57a c2ef8447-b446-4b32-9975-f12915c5cb21 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,969 mnist_classifier_MNISTClassifier nt74n57a 8e328d6c-72af-4cf8-8488-6645c1caf261 -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,969 mnist_classifier_MNISTClassifier nt74n57a e92156ed-6899-465d-be4b-cb2555547889 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,969 mnist_classifier_MNISTClassifier nt74n57a c09956af-9eb4-416e-b47d-7d72309b6255 -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,970 mnist_classifier_MNISTClassifier nt74n57a 5c12aaf4-4f4c-4831-b4ec-c33c945a62e1 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,970 mnist_classifier_MNISTClassifier nt74n57a 0c8a9b81-22ba-4a54-9da9-0e877eb4e3b5 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,971 mnist_classifier_MNISTClassifier nt74n57a 4da4a1f0-121b-42b5-a83e-d8e1fa688402 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,971 mnist_classifier_MNISTClassifier nt74n57a 5381f653-bde0-4b73-ad7e-177d3c79abdf -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,971 mnist_classifier_MNISTClassifier nt74n57a c77816fd-fb80-496d-aa90-ebc2d413583e -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,972 mnist_classifier_MNISTClassifier nt74n57a a4b65202-b0b7-425a-92c5-f80b3ff2410c -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,974 mnist_classifier_MNISTClassifier nt74n57a c4a25703-2579-4daa-9244-01b7992fa074 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,975 mnist_classifier_MNISTClassifier nt74n57a b8975970-31d3-46c4-bd0d-ae52075bdc18 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,976 mnist_classifier_MNISTClassifier nt74n57a 969a6f06-07a8-4945-ab21-a45740521952 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,977 mnist_classifier_MNISTClassifier nt74n57a a3e8b3c0-e6c3-44f7-be2f-3e63dd59fade -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,977 mnist_classifier_MNISTClassifier nt74n57a 5f4b3e0d-dbb6-422f-9da5-5542890d99d9 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,978 mnist_classifier_MNISTClassifier nt74n57a b4a3908c-f365-4e18-8f61-e213dc4d66eb -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,978 mnist_classifier_MNISTClassifier nt74n57a 67ea50c4-4474-4ab3-8e21-421afb469c34 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,979 mnist_classifier_MNISTClassifier nt74n57a 650e5a8a-8af0-4372-9f77-1d4902143645 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,981 mnist_classifier_MNISTClassifier nt74n57a 89f6e1ec-02b7-48e5-a814-cf0a5c20cb6f -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,981 mnist_classifier_MNISTClassifier nt74n57a 658b0215-acb3-4c65-94b0-028ba4ba911e -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,981 mnist_classifier_MNISTClassifier nt74n57a a774d2e3-a9c5-4fca-9861-c067f1c2a2b2 -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,982 mnist_classifier_MNISTClassifier nt74n57a e3fa752d-e13f-4645-bf86-da16d19927d3 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,983 mnist_classifier_MNISTClassifier nt74n57a a02d36b7-7828-4cb0-ae53-b7dcad86d795 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,984 mnist_classifier_MNISTClassifier nt74n57a bb94ecbb-0c70-42a3-bfcb-b61a09277c91 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,985 mnist_classifier_MNISTClassifier nt74n57a da1d4a43-7361-4abc-afdb-e9ce0519bef3 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,985 mnist_classifier_MNISTClassifier nt74n57a 6b15e516-3cbb-4dd7-a27b-493f26c0708f -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,985 mnist_classifier_MNISTClassifier nt74n57a c0435617-e27f-43d7-93a3-6328342b0815 -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,986 mnist_classifier_MNISTClassifier nt74n57a 6e2550ff-2847-47c2-9d51-505540a71948 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,986 mnist_classifier_MNISTClassifier nt74n57a e42821c3-ac97-4c50-85dc-dd5aefd2e963 -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,986 mnist_classifier_MNISTClassifier nt74n57a e3ff0fff-bcf0-4c43-ac32-e745573f7fdc -- POST / 200 235.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,986 mnist_classifier_MNISTClassifier nt74n57a 59734876-d41c-436c-9700-2e429b1c1dcf -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,987 mnist_classifier_MNISTClassifier nt74n57a f9ac7e38-c372-4e7d-baa1-01ff33ab7ab1 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,987 mnist_classifier_MNISTClassifier nt74n57a 532e5c02-2abd-4dcc-baf8-d2dae7491453 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,987 mnist_classifier_MNISTClassifier nt74n57a e3bee08c-ada9-4101-98ee-b154477af7e4 -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,987 mnist_classifier_MNISTClassifier nt74n57a 30f9b4e2-8b1f-4e50-8bc0-4f1ea171958e -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,988 mnist_classifier_MNISTClassifier nt74n57a 39aabee7-4a55-4cbe-b87a-9c2301d5935d -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,988 mnist_classifier_MNISTClassifier nt74n57a ea27e9af-9fa7-46fe-bbf7-8196b492b09a -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,989 mnist_classifier_MNISTClassifier nt74n57a 6d3d5c1d-4cdd-40ea-98d9-4472f769a134 -- POST / 200 222.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,989 mnist_classifier_MNISTClassifier nt74n57a 17a89d04-bf46-47e1-8bd5-3f9e3f684054 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,990 mnist_classifier_MNISTClassifier nt74n57a 3dd90548-f132-4c7f-baf8-b683c76ac5bd -- POST / 200 222.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,991 mnist_classifier_MNISTClassifier nt74n57a 21b58822-6187-4411-bf58-9ae5a403f6c9 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,992 mnist_classifier_MNISTClassifier nt74n57a dc9a1e4d-8a7a-4b19-a27e-b86d76155a01 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,992 mnist_classifier_MNISTClassifier nt74n57a 4d0872db-5809-4082-b95c-8e656f4f9e19 -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,992 mnist_classifier_MNISTClassifier nt74n57a 63e57766-84d2-47bc-a04f-940df7a28a46 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,993 mnist_classifier_MNISTClassifier nt74n57a 224be2bc-0e1e-4142-80aa-11bc847f014a -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,994 mnist_classifier_MNISTClassifier nt74n57a 317c3d8e-3d80-4ab7-be7f-aaec50405b2d -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,995 mnist_classifier_MNISTClassifier nt74n57a adc5797a-216b-4b60-a8e9-d8ce745a5d7f -- POST / 200 216.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,995 mnist_classifier_MNISTClassifier nt74n57a 7233f07b-b1c3-4c8f-a5a3-8a6468f6136b -- POST / 200 216.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,995 mnist_classifier_MNISTClassifier nt74n57a c59ef9bf-d913-42a6-9f5f-c32159e62e5c -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,995 mnist_classifier_MNISTClassifier nt74n57a 9cfe22fc-ecf2-4bad-8b27-c9650ebe4351 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,995 mnist_classifier_MNISTClassifier nt74n57a 40a96fb7-2814-4d8f-a49f-f267ac5920a7 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,996 mnist_classifier_MNISTClassifier nt74n57a b3cdc8ae-757d-4439-a66a-936b9d09953b -- POST / 200 211.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,996 mnist_classifier_MNISTClassifier nt74n57a 38da9d67-5026-4386-895f-29ae0f0862c0 -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,997 mnist_classifier_MNISTClassifier nt74n57a 993d8b57-5ed6-4921-a08f-e09ab82ff91d -- POST / 200 212.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,997 mnist_classifier_MNISTClassifier nt74n57a b43b167f-5608-4166-a458-0cefd733f369 -- POST / 200 209.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,997 mnist_classifier_MNISTClassifier nt74n57a db07fe31-7752-4146-aa41-1979945728a8 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,997 mnist_classifier_MNISTClassifier nt74n57a 23e88a46-2210-4960-bb54-23a0cc7e227f -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,998 mnist_classifier_MNISTClassifier nt74n57a 64360744-20d7-4294-b350-09e423f3f590 -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,999 mnist_classifier_MNISTClassifier nt74n57a 5eb0ceaa-a6b4-4eed-9e42-37a326fd6806 -- POST / 200 203.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,999 mnist_classifier_MNISTClassifier nt74n57a afb1f90c-f555-4796-8062-85d8182c18c0 -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,999 mnist_classifier_MNISTClassifier nt74n57a 776bf352-13fb-482c-8add-b255014116d5 -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:05,999 mnist_classifier_MNISTClassifier nt74n57a 95f64f1c-4cb0-45ca-b5f8-40dbc458d129 -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,028 mnist_classifier_MNISTClassifier nt74n57a 9b28f84a-2d63-4d1c-905c-d390a90649e2 -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,029 mnist_classifier_MNISTClassifier nt74n57a 9ea9c750-7f1b-4ba0-ab6a-a84cedddc724 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,029 mnist_classifier_MNISTClassifier nt74n57a 0516ad17-819f-430f-80ad-8978df48c87c -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,030 mnist_classifier_MNISTClassifier nt74n57a 127012e1-cc00-43ee-8b8f-e9190e8dca96 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,031 mnist_classifier_MNISTClassifier nt74n57a 9ff1683e-cab1-412b-8107-e3f72aa1430c -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,031 mnist_classifier_MNISTClassifier nt74n57a 9b496de3-7e3c-4e51-978e-a63bb6819080 -- POST / 200 227.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,034 mnist_classifier_MNISTClassifier nt74n57a ae64d405-8628-4b87-a550-06f4b23f4acc -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,035 mnist_classifier_MNISTClassifier nt74n57a 83cbc581-5013-41d9-8d53-be0dc201622a -- POST / 200 175.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,035 mnist_classifier_MNISTClassifier nt74n57a 2765b040-8de7-4bf0-af09-f02172a8c93c -- POST / 200 165.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,036 mnist_classifier_MNISTClassifier nt74n57a e1e93b6d-e6c4-452d-addb-a2e28080408b -- POST / 200 164.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,036 mnist_classifier_MNISTClassifier nt74n57a a6b3a07b-df3b-453f-be9f-eb65960acab1 -- POST / 200 164.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,036 mnist_classifier_MNISTClassifier nt74n57a 21b13380-93ae-43b8-9896-61eaf501a1c7 -- POST / 200 164.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,037 mnist_classifier_MNISTClassifier nt74n57a 994530e9-1b28-4f0f-b9c1-fb1ff784c32a -- POST / 200 163.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,037 mnist_classifier_MNISTClassifier nt74n57a 8bbdd652-67a1-423d-bf2c-cebea9928066 -- POST / 200 161.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,037 mnist_classifier_MNISTClassifier nt74n57a c570a4cf-b6f0-45a6-9ebc-d68657b6914c -- POST / 200 159.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,038 mnist_classifier_MNISTClassifier nt74n57a 85d4fd9f-09aa-4063-89e3-eed115cabc9a -- POST / 200 159.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5052) INFO 2026-06-29 19:52:06,038 mnist_classifier_MNISTClassifier nt74n57a 0bf166b2-fac8-4520-a11b-d100d3cf375c -- POST / 200 159.6ms
Processed 1000 requests in 5.04 seconds
Throughput: 198.30 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.