Job Description
About the role
We’re looking for a motivated LLM Systems Engineer willing to explore new and unconventional inference systems based on emerging hardware.
This role is part engineering, part research – you’ll be responsible for searching and prototyping various algorithms suitable for our inference hardware, as well as guiding our hardware team on the product definition. The ideal candidate has a proven track of record of pursuing ML systems research, and is very familiar with industry-standard LLM inference systems.
This role will be performed on-site from one of our offices in Santa Clara, CA or Boston, MA.
Essential Duties and Responsibilities
• Prototype and optimize emerging ML inference systems.
• Develop novel memory models for expandable vRAM.
• Write efficient GPU kernels for data movement.
• Perform design-space exploration, implementation, and benchmarking of inference engines, both in simulations and on real hardware.
Qualifications
• MS or PhD in computer systems, ideally with a focus on LLM inference and/or distributed systems.
• Prior experience contributing to the core LLM inference infrastructures (vLLM, SGLang, TensorRT, etc.).
• Prior experience in accelerator programming (e.g. CUDA, JAX/Pallas, ROCm).
• Advanced computer architectures and performance engineering skills is a big plus.
Compensation & Benefits
• Competitive salary commensurate with experience including base salary, incentive-based bonus, and early stage equity grant.
• Comprehensive benefits including health, dental, vision, and life insurance.
• Well-equipped, sunny offices in Santa Clara, CA and Boston, MA.
• Relocation assistance and visa sponsorship.
• Perks include a daily lunch stipend, 401k match, and more.
• A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing.
The Opportunity
• Impact: We are tackling a fundamental challenge at the infrastructure layer: unlocking greater AI capability while dramatically improving efficiency. The work we do here compounds across state-of-the-art AI models, systems, and real-world applications.
• Timing: Joining now means real ownership of the company and meaningful influence over product direction and execution. You’ll work from first principles, move quickly from insight to execution, and see your contributions directly reflected in what we build.
• Culture: You’ll work alongside a group of people who care deeply about rigor, clarity, and impact. We value thoughtful disagreement, fast learning, and intellectual fearlessness. This is a place where strong ideas shine, curiosity is encouraged, and growth is a daily practice.
...talented technical writer to join their stealth mode startup on a freelance basis. This remote role requires at least 10 hours a week to... ...workplace.The ideal candidate will have a strong background in writing for B2B tech companies and be passionate about storytelling....
...Description: The Department of Dermatology at theUniversity of Iowa Carver College of Medicineis seeking aboard-certified or board-eligible Mohs Surgeonto join our growing team of academic dermatologists. This is an outstanding opportunity to practice in ahigh-volume,...
...schedule ~ Opportunity for advancement About the Role: Karing Hearts Home Health is looking for a compassionate and skilled Per Diem RN to join our Home Infusion team in Los Angeles, CA. This is a rewarding opportunity to deliver high-quality, patient-centered...
...Middle School Job Title: Tutor Wage/Hour Status: Part-time Reports to: Principal and Teacher(s) Assigned Pay Grade: $25.00 per hr. (certified) $35.00 per hr. (retired from TRS) Dept./School: Assigned Work Days: During and/or after school hours...
...**Summary:**Humano is seeking Warehouse Dock Workers/General Laborers/Unloaders for their warehouse in Piscataway, New Jersey.... ...warehouse worker / freight handler / General labor / top performing distribution center that wants to make great money, keep reading!Benefits:...