Skip to content

feat(server): add TLS certificate support - #230

Open
calvarado2004 wants to merge 1 commit into
FlashML-org:mainfrom
calvarado2004:feat/serve-tls
Open

feat(server): add TLS certificate support#230
calvarado2004 wants to merge 1 commit into
FlashML-org:mainfrom
calvarado2004:feat/serve-tls

Conversation

@calvarado2004

Copy link
Copy Markdown

Summary

  • add optional, vLLM-compatible --ssl-certfile and --ssl-keyfile flags to ft serve
  • require the certificate and private key as a pair, then pass them to Uvicorn for direct HTTPS serving
  • preserve plain HTTP as the default and reject TLS in attached shell mode, whose loopback client currently assumes HTTP
  • document HTTPS usage and cover parsing, validation, Uvicorn forwarding, and the unchanged HTTP default

Motivation

FreeToken currently calls Uvicorn without exposing its TLS settings, so deployments must add a separate reverse proxy even when the inference server should terminate TLS directly. This adds the minimal native path while leaving existing deployments unchanged.

Testing

  • python -m pytest -q tests/server — 540 passed
  • python -m py_compile python/freetoken/server/args.py python/freetoken/server/api_server.py tests/server/test_tls_args.py

I also checked open and closed FreeToken PRs for TLS/SSL/certificate support and inspected every open PR touching the server argument, launch, or API-server paths; no overlapping implementation was found.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant