Woongjin, INC.

Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Woongjin, INC.  •  Plano, TX (Onsite)  •  15 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

For More Open Positions Visit us at:
http://recruiting.woongjininc.com/

Our Mission

WOONGJIN INC. is a rapidly growing team who provides a range of unique, exceptional, and enhanced services to our clients. We have a strong moral code that includes the service of goodness without expectations of reward. We are motivated by the sense of responsibility and servant leadership.

We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.

What we are looking for

  • Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
  • Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
  • Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
  • FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
  • Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
  • Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
  • PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
  • Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
  • IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Qualifications

  • Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
  • IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
  • AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
  • API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
  • Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).
  • Bilingual Korean Highly Prefer

Additional Information

All your information will be kept confidential according to EEO guidelines.

*****NO C2C******

Woongjin, INC.

About Woongjin, INC.

Woongjin, Inc. is a corporation that specializes in Staffing & Recruiting, IT Consulting and Software Solutions.

Woongjin, Inc. Talent Acquisition Team specializes in Staffing & Recruiting. We assist clients all over the US with their needs. The services we provide create value to our client's, candidates', and customers' goals. We are committed to providing the best suitable Talents. With our core values - honesty, passion, and creativity, we will devote ourselves to continuous innovation to flexibly respond to rapidly changing job markets.

Woongjin, Inc. has 'extraordinary ideas for customers'. We cultivate relationships into partnerships which makes a dynamic culture on the basis of love, trust, and respect. Our priority is to value our Talent with the deepest gratitude.

Our Staffing/Recruitment Specialties:

Logistics | Supply Chain Management/ Finance and Accounting | General/HR | Sales/Account Manager | Business Analyst | SAP/ ERP | Information Technology | Technical Support | Software Engineer | IT Developer | Project Manager | Network and system Admin

Industry
HR & Recruiting
Company Size
51-200 employees
Headquarters
Buena Park, California
Year Founded
Unknown
Social Media