Member of Technical Staff
Fireworks AI is seeking a Member of Technical Staff to design, develop, and maintain its generative AI infrastructure. This role emphasizes building scalable backend systems for machine learning training and inference, collaborating with various teams to deliver robust technology solutions. The company, valued at $4 billion, is backed by leading investors and offers a competitive salary and equity in a fast-growing startup. Candidates should have extensive experience in software engineering and cloud environments.
Job description
About Us:
At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.
Job Duties:
- Design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for generative AI platform.
- Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines.
- Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems.
- Design and implement core backend services with a focus on efficiency and low latency.
- Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance.
- Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions.
- Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability.
- Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence.
Minimum Education & Experience Required:
Bachelor’s degree or equivalent in Computer Science or related field plus four (4) years of experience in software engineering or related role.
Minimum Skills Required:
- 4 years of experience designing, building, and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, Apache Flink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms, core infrastructure components, and optimization techniques (caching, indexing, sharding, replication, transactions, ACID).
- 4 years of experience with major server-side programming languages and frameworks (e.g., Python, C++, Go, TypeScript).
- 4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact.
- 3 years of experience developing and maintaining data processing and API systems, including client-server communication frameworks (e.g., gRPC, Thrift).
- 3 years of experience conducting A/B testing and scientific experimentation (e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact.
- 3 years of experience conducting coding interviews and providing systematic feedback for engineering candidates.
- 2 years of experience with cloud-native tools and infrastructure, such as Docker and Kubernetes.
- 2 years of experience defining and implementing data-driven metrics to support company or team goals.
Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted. Base Pay Range (Plus Equity) $175,000 - $220,000USD
Why Fireworks AI?
- Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
- Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
- Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
- Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.
Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.
Job details
- Published
- June 11, 2026
- Last checked
- July 31, 2026
- Job source
- greenhouse
- Workplace
- On-site · New York, US
- First seen
- June 11, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Fireworks AI
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Member of Technical StaffFireworks AINew York, USOn-site$175,000–$220,000 per year
- Member of Technical StaffBeacon SoftwareNew York, USRemote
- Member of Technical StaffCleraPalo Alto, USRemote$150,000–$230,000 per year
- Member of Technical StaffReasonable AILondon, GBHybrid
- Member of Technical StaffPerplexitySan Francisco, USOn-site
- Member of Technical Staffathena IndiaChennai, INOn-site
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.