
Member of Technical Staff, LLM & Production
Hark is seeking an engineer to join their Omni team, focusing on the next generation of AI experiences. This role involves the intersection of model research and production systems, requiring you to build end-to-end evaluation suites for LLM capabilities. You'll manage data pipelines, simulate training environments, and collaborate closely with researchers to assess model performance. The ideal candidate will have significant experience in software engineering and LLMs, particularly in creating robust evaluation infrastructures.
Job description
About Hark
Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world. To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
About the Role
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and vision. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences. We're looking for an engineer who sits at the intersection of model research and production systems. Together with our researchers, you'll decide what "better" means for a model and how to prove it — then build the infrastructure that makes those proofs reliable and repeatable: evaluation harnesses, data pipelines, and model training that hold up at scale and that the whole team can build on. This is a hands-on, individual-contributor position. The systems that judge whether a model improved, and the environments that drive that improvement, will be yours.
Responsibilities
- Build and own end-to-end evaluation suites for LLM capabilities: task specs, grading logic, and the dashboards researchers check every day.
- Run the eval harness as a production service — sandboxed execution, tool calling, multi-turn and agentic tasks, deterministic replay, and caching — so a full evaluation pass is cheap and gives the same answer twice.
- Own the data pipeline from source to training: collection, filtering, dedup, labeling workflows, synthetic data generation, and the quality gates that catch contamination and distribution drift before anything reaches a run.
- Build RL training environments — reward functions, simulators, verifiers, task generators — and keep them stable as they fan out across many workers.
- Work side by side with researchers: turn a hypothesis into a runnable eval or environment within days, then help make sense of what comes back.
- Pull capabilities out of the product layer and into the model. Find where product teams lean on long prompt instructions or hand-written skills, build the evals and environments that teach the model to do those things natively, and retire the workarounds once it can.
- Measure everything: eval regressions, environment health, throughput, cost — and make it obvious when a metric moved for the wrong reason.
- Raise the bar for research code across the team: tests, versioned datasets and evals, and clean boundaries between training, inference, and evaluation.
Requirements
- 3+ years in software engineering, including 1-2 years hands-on with LLM training, evaluation, or data infrastructure.
- Deep Python fluency and real distributed-systems experience: you've chased failures across a fleet of machines, dealt with unreliable workers, and know where the compute budget actually goes.
- You've built evaluation infrastructure, not just run benchmarks — designing tasks, graders, and the plumbing around them.
- Working knowledge of SFT and RL for language models.
- Production instincts: you write tests, insist on reproducibility, and treat research tooling as something others depend on — because they do.
- Comfortable in ambiguity next to researchers: handed a half-formed idea, you can make it measurable.
Bonus Qualifications
- Agentic evaluation experience: tool use, code execution, sandbox environments, multi-turn tasks.
- Hands-on with training frameworks and inference stacks (e.g., PyTorch, JAX, vLLM, SGLang, or in-house equivalents).
- Experience running data-labeling operations or collecting human preferences at scale.
- Contributions to open-source evaluation frameworks or public benchmarks.
- Previous work on verifiers, code sandboxes, or simulation environments.
Compensation
The US base salary range for this full-time position is between $180,000 - $450,000 annually. The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
Job details
- Published
- October 12, 2026
- Last checked
- November 18, 2026
- Experience
- Staff
- Job source
- greenhouse
- Workplace
- On-site · San Jose, US
- First seen
- October 12, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Hark hiring intelligence
Hark currently has 15 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.
Verified November 18, 2026
Active openings
15
Currently tracked by LiftmyCV
New in 7 days
1
9 new jobs in the past 30 days
Published salaries
80%
Median disclosed salary: $282,500
Average opening age
55 days
Across 15 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Business Development Manager
- • Finance Manager
- • Industrial Designer
- • Lead Brand Designer
- • Member of Technical Staff, Computer-Use Agents
- • Member of Technical Staff, Distributed Training Performance
Frequently requested skills
Median disclosed salary: $282,500 · 80% of jobs publish a salary
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Hark
Similar jobs from this company
- Member of Technical Staff, Multimodal Pretraining DataHarkSan Jose, USOn-site$180,000–$450,000 per year
- Member of Technical Staff, Pretraining EvaluationsHarkSan Jose, USOn-site$180,000–$450,000 per year
- Member of Technical Staff, Mid-trainingHarkSan Jose, USOn-site$180,000–$450,000 per year
- Member of Technical Staff, Pretraining Architecture and ScalingHarkSan Jose, USOn-site$180,000–$450,000 per year
- Technical Customer Experience LeadHarkSan Jose, USOn-site$120,000–$170,000 per year
- Member of Technical Staff, Distributed Training PerformanceHarkSan Jose, USOn-site$180,000–$450,000 per year
Across the market
Similar jobs from other companies
- Member of Technical Staff, ProductionSlingshot AILondon, GBHybrid
- Member of Technical Staff, ProductCleraSan Francisco, USHybrid
- Member of Technical Staff - ProductEragonSan Francisco, US
- Member of Technical Staff [Product]NeoCognitionPalo Alto, USRemote
- Member of the Technical Staff - ProductAndromeda ClusterSan Francisco, USRemote
- Member of Technical Staff, ProductionInco AIPalo Alto, US
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.