Job Description

Job Description

ONLY LOCAL Candidates please..

Staff Software Engineer Large Language Models (LLMs) | Healthcare AI

Are you a software engineer passionate about applying Large Language Models (LLMs) to real-world problems? Do you thrive in start-up environments where every line of code makes an impact? We are seeking a Staff Software Engineer to help us design, build, and scale AI-first applications that are transforming healthcare operations.

This is a hands-on engineering role not infrastructure-heavy, not a pure data science role. You will spend your days coding in Python, fine-tuning and deploying LLMs in production, and collaborating closely with product and healthcare domain experts to deliver real impact. With a lean team structure, every hire has exponential value, and your contributions will be highly visible. If you ve successfully implemented LLMs before, are comfortable working in a fast-paced, entrepreneurial environment, and want to see your work directly improve healthcare outcomes, we d love to talk to you.

What You ll Do:

• Design, build, and optimize ML-driven software systems with a focus on LLM applications in healthcare.
• Develop scalable pipelines for ingestion, training, evaluation, and deployment of LLMs.
• Collaborate with product, engineering, and healthcare experts to design AI-first solutions.
• Implement best practices for LLM development: evaluation, monitoring, reproducibility, and responsible AI.
• Lead projects end-to-end, from prototyping through production deployment.
• Mentor teammates and contribute to a strong, collaborative engineering culture.

What We re Looking For:

• 5+ years of software engineering experience, with 3+ years in applied ML/LLM systems.
• Strong Python skills and experience with ML frameworks (PyTorch, TensorFlow, Hugging Face).
• Hands-on experience fine-tuning and deploying LLMs in production.
• Solid foundation in distributed systems, API design, and data-intensive architectures.
• Familiarity with cloud (AWS, Google Cloud Platform, or Azure), Docker, and Kubernetes.
• Excellent communication skills to collaborate across technical and non-technical teams.
• Driven, entrepreneurial mindset; eager to code daily and raise the bar.

Nice to Have:

• Experience applying ML/LLMs in healthcare or regulated industries.
• Knowledge of FHIR, HL7, or other healthcare interoperability standards.
• Background in real-time systems, speech/voice models, or telephony platforms.
• Track record building enterprise SaaS products with ML/AI.
• Understanding of ethical AI principles in production environments.

Why Join Us:

• Work with cutting-edge AI in one of the world s most impactful industries: healthcare.
• Take ownership over critical LLM systems and influence technical direction.
• Be part of a small, entrepreneurial team where your contributions have immediate impact.
• Competitive compensation, equity options, and comprehensive benefits (health, dental, vision).
• Office in Burlingame, CA hybrid model, 4 days a week onsite (Mon Thurs).

Job Tags

Similar Jobs