
Working Student - LLM Quantization & Inference Performance
Tensordyne, an innovative AI solution company, seeks a motivated working student for LLM quantization and inference performance optimization. This role involves evaluating model quality, conducting quantization research, and developing reproducible evaluation tools, with a focus on improving runtime efficiency while maintaining task accuracy. Candidates should be currently enrolled in relevant master’s programs, possess strong Python and PyTorch skills, and demonstrate an experimental mindset. Join a dynamic team to translate academic knowledge into real-world applications while contributing to the future of multimodal generative AI.
Job description
About Tensordyne (formerly Recogni)
AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications.Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!
Role summary
How much numerical precision does an LLM need, and where in the model architecture does it matter most? When does quantization improve runtime, and what does it cost in model quality? We’re looking for a motivated working student to help turn these questions into experiments and experiments into maintainable code. You’ll explore optimization methods and build reusable evaluation tooling. You’ll work closely with our quantization, compiler, and runtime engineers, and your findings will directly influence how we optimize models for Tensordyne hardware.
What you will do
- Model quality evaluation: Measure how low-precision computation affects performance on coding and reasoning benchmarks. Diagnose where quantization has the greatest impact.
- Quantization research: Implement and compare post-training quantization methods to improve inference efficiency while preserving task accuracy.
- Build reproducible tooling: Automate evaluations, track configurations and results, and make experiments accessible to engineers and AI agents.
- Measure runtime performance: Characterize latency, throughput, and memory usage to understand bottlenecks under different deployment scenarios.
A first project could involve exploring the quality–performance Pareto frontier of a Qwen or LlaMa model. You’ll experiment with 16-bit, 8-bit, and 4-bit quantization configurations to find the best runtime-quality tradeoff.
Core qualifications
- Current enrollment in Computer Science, Mathematics, Electrical Engineering, Machine Learning, or a related master’s degree program.
- Strong Python and PyTorch skills, including the ability to understand and modify model implementations.
- Effective use of AI coding tools and critical review of their output.
- An experimental mindset: you can formulate hypotheses, design comparisons, and draw careful conclusions from noisy results.
- Clear communication and the ability to present experimental findings and technical tradeoffs to the team.
Strong pluses: experience with quantization, LLM evaluation, performance profiling, or inference optimization. This role is for you if you thrive on responsibility, learn quickly, and are naturally proactive.
What we offer
Join a deep-tech team building the next generation of AI inference systems. Put your university knowledge into practice with leading open-source LLMs, deepen your understanding of quantization and inference optimization, and build skills in experimental design, software engineering, and AI coding tools. You’ll own a focused project, receive close mentorship from experienced engineers, and have room to explore ideas that shape our optimization methods.
Tensordyne's culture was built on the following values
- Put people first. We only succeed when our people succeed.
- Ethics and integrity always. Be open, honest, and respectful of everyone.
- Think Big. Be ambitious and have audacious goals.
- Aim for excellence. Quality and excellence count in everything we do.
- Own it and get it done. Results matter!
- Make each person better together than they would be as an individual.
- Embrace each other’s differences, and embrace that there will be differences.
Tensordyne is an equal opportunity employer. We believe diverse teams are better equipped to solve complex problems and build exceptional technology. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. A note to recruitment agencies: Please do not contact Tensordyne employees or leaders regarding this role. We do not accept unsolicited agency resumes and are not responsible for fees associated with unsolicited submissions.
Job details
- Published
- October 14, 2026
- Last checked
- November 17, 2026
- Job source
- greenhouse
- Workplace
- On-site · Munich, DE
- First seen
- October 15, 2026
Benefits
Mentorship from experienced engineers, exploration of optimization methods, and practical application of university knowledge.
Skills mentioned in this job
LiftmyCV exclusive data
Tensordyne hiring intelligence
Tensordyne currently has 10 active jobs tracked by LiftmyCV. 1 new jobs in the past 7 days.
Verified November 17, 2026
Active openings
10
Currently tracked by LiftmyCV
New in 7 days
1
7 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
84 days
Across 10 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Ops/Developer Platform Engineer
- • Senior Software Engineer — ML Inference & Numerics
- • Senior Software Engineer, Inference Performance
- • Software Engineer – Cloud Services – Rust
- • Sr. Compiler Engineer
- • System Software / Embedded Engineer
Frequently requested skills
As of November 17, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Tensordyne
Similar jobs from this company
Across the market
Similar jobs from other companies
- Senior Software Engineer, Quantized InferenceNVIDIA USAUnited States, WA, RedmondOn-site
- Performance Engineer, InferenceSarvamBengaluru, IN
- Inference Performance EngineerBasetenSan Francisco, USHybrid
- Performance Engineer, Inference SystemsAnthropicSan Francisco, USHybrid$350,000–$850,000 per year
- Engineering Manager - Inference PerformanceBasetenSan Francisco, USHybrid
- Inference Performance Engineer - MaaSBitdeer Technologies GroupSingapore, SGOn-site
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.