Software Engineer - Infrastructure (Mid - Senior) Job at Julius Ai, San Francisco, CA

  • Julius Ai
  • San Francisco, CA

Job Description

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes ( isolated remote containers ) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Job Tags

Full time, Remote work

Similar Jobs

Catalytic Solutions

Travel Nurse RN - Case Manager - $2,841 per week in Apple Valley, CA Job at Catalytic Solutions

 ...Nurse (RN) | Case Manager Location: Apple Valley, CA Agency: Catalytic Solutions...  ...is for a 13 weeks contract. You will be working 5 days per week, 8 hours per shift and on...  ...Hollywood), agriculture, and aerospace. Home to the world's oldest and tallest trees... 

Cynet Health

Travel Nurse RN - Progressive Care Unit - $2,271 per week in Kansas City, MO Job at Cynet Health

Registered Nurse (RN) | Progressive Care Unit Location: Kansas City, MO Agency: Cynet Health Pay: $2,271 per week Shift Information: Nights - 3 days x 12 hours Contract Duration: 13 Weeks Start Date: 10/26/2026 About the Position Job...

Texas Tech University

Senior Director of Development Job at Texas Tech University

 ...largest public art collections. Its 13 colleges include a prestigious School of Law and...  ...grit and authenticity the university graduates students who are deeply engaged in service...  ...cultivation cycle. Texas Tech University recently announced the public phase of its first... 

Ramos James Law, PLLC

Personal Injury Attorney Job at Ramos James Law, PLLC

 ...Ability to manage a heavy, fast-moving caseload Strong research, writing, communication, and courtroom skills Proficiency with Dropbox, Slack, case management systems, and AI tools Proactive, solutions-oriented mindset Team-first, humble, supportive approach Commitment... 

Data Cloud Merge

Junior Business Analyst: Requirements & User Stories Job at Data Cloud Merge

 ...Data Cloud Merge, located in Houston, Texas, is seeking an Entry Level Business Analyst to assist with evaluating business processes and requirements analysis.The successful candidate will work closely with Product and Development teams to translate business needs into...