Backend engineer โ reliable, secure infrastructure for AI systems
distributed reliability ยท data consistency ยท runtime correctness, security & cost accuracy for LLM / agent platforms
๐ Based in South Korea โ open to global roles (remote or relocation)
๐ฐ๐ท ํ๊ตญ์ด ์๊ฐ
๋๊ท๋ชจ ์๋น์ค ํ๊ฒฝ์์ ์ ๋ขฐ์ฑ๊ณผ ๋ฐ์ดํฐ ์ ํฉ์ฑ์ ๊ณ ๋ คํ ๋ฐฑ์๋๋ฅผ ์ค๊ณํ๊ณ ,
LLM/์์ด์ ํธ ํ๋ซํผ์ ๋ฐํ์ ์ ํ์ฑยท๋ณด์ยท๋น์ฉ์ ๋ค๋ฃน๋๋ค. ๋ฆฌ๋ชจํธยท์ด์ฃผ ๋ชจ๋ ๊ฐ๋ฅํ๋ฉฐ ๊ธ๋ก๋ฒ ํฌ์ง์
์ ์ฐพ๊ณ ์์ต๋๋ค.
Solo-designed Python library that enforces guardrails, a policy engine, and audit logging on every LLM call and tool execution โ at the CI/CD layer. Auto-instruments 12 AI frameworks (LangChain, CrewAI, OpenAI, Anthropic, LiteLLM, Google ADK โฆ).
flowchart LR
C["LLM call / tool exec"] --> AE["Aegis"]
AE --> GR["Guardrails"]
AE --> PO["Policy engine"]
AE --> AU["Audit log"]
AE --> D{"allow / block"}
Integrates as a third-party guardrail provider for Pydantic AI and LiteLLM ยท listed in awesome-mcp-servers and Awesome-LM-SSP.
Fixing real correctness & cost bugs in the tools I use in production:
- litellm โ bill xAI from its reported cost instead of stale recomputation (#36281)
- Spring AI โ DeepSeek tool-call
content=nullfallback (#3817) ยท RedisVectorStoreBuilderCustomizer(#3809)
In production today โ backend for an enterprise LLM gateway / AI-security platform (Soosan): proxy request lifecycle, DLP and guardrail enforcement, cross-provider correctness, policy & audit paths, load and reliability testing.
CandyPod โ backend engineer on a mobile matching app, live on the App Store and Google Play.
distributed reliability ยท fault isolation & recovery ยท data consistency ยท LLM / agent runtime security ยท cross-provider correctness & cost accuracy ยท AI-native system design
- Soosan (current)
- Koosstech โ Backend & DevOps (E2E ownership)
- MementoAI โ Backend (intern)
- ROK Air Force โ mission-critical systems operations
Earlier: PassionPay โ MSA fintech payments platform (lead), payment-service architecture & consistency design.
Tech blog โ https://victorica.tistory.com/ ยท ๐ง koo9811@naver.com ยท ๐ผ linkedin.com/in/otkling



