Senior Research Scientist – Efficient Multimodal Video Generation
If you are enthusiastic in shaping Huawei’s European Research Institute together with a multicultural team of leading researchers, this is the right opportunity for you!
About Us
Huawei is a global leader in information and communications technology (ICT), driving innovation and shaping the future of an intelligent world. With a presence in over 170 countries and a strong commitment to research and development, Huawei continues to push the boundaries of technology.
Huawei's European Research Institute (ERI) brings together more than 1,500 researchers across over 20 sites in Europe, including our Research Center in Switzerland.
Our Swiss research laboratory focuses on pioneering next-generation computing architectures and systems for the AI era, spanning innovative hardware, software, and algorithms. Working closely with leading universities and academic partners worldwide, we foster an open, collaborative research environment dedicated to fundamental scientific breakthroughs and long-term innovation.
Our vision is to become a world-leading research center for computing architectures and systems in the AI era, shaping the future of intelligent computing.
About the Team
We are a research team based in Europe, working at the intersection of Generative AI, Video and Efficient AI. We collaborate closely with leading universities and research institutions, and with engineering teams, to explore and build the next generation of efficient multimodal AI systems.
Our work centres on efficient real-time video generation. We are moving toward mixture-of-experts (MoE) video models, streaming world models, and models that keep learning while they generate.
The team has two streams: Architecture and Systems, and Multimodal Efficiency. This position is in the Multimodal Efficiency stream, which makes video and multimodal models faster and cheaper at the model and algorithm level, and works closely with the systems stream to run them in real time on NPU/GPU clusters.
The Role
We are looking for a Senior Research Scientist to lead research on making large multimodal and video generation models faster and more efficient. You will shape the research directions of the Multimodal Efficiency stream, lead projects from problem formulation to results at scale, and mentor researchers and interns. You will stay hands-on: implementing, running experiments and building working systems.
What You Will Work On
You will lead one or more of these topics and guide the stream across the others.
· Token efficiency for video: adaptive, content-aware token compression and merging, and positional encodings (e.g. RoPE) designed to work with compressed or multi-resolution tokens
· Long-horizon and streaming generation: memory- and KV-cache-efficient autoregressive video, history compression, and few-step and streaming distillation
· Sparse and structured attention for long video sequences
· Step distillation, caching across denoising steps, and pruning
· Quantization and low-precision inference (FP8/FP4, MX formats) for diffusion and flow-matching models
· MoE video models: expert routing and MoE-specific acceleration
· Efficient end-to-end execution of large multimodal models, including VAE encoding and decoding, and joint audio-video generation
· Efficient agentic multimodal pipelines: agents that call LLMs, VLMs and video/speech generators, with KV cache reuse across steps and latency-aware planning
· Workload analysis and hardware-aware model design: compute, memory and latency models that guide algorithm choices on NPUs and GPUs, together with the systems stream
Your Responsibilities
· Define and lead research directions in the Multimodal Efficiency stream, aligned with the team roadmap
· Lead projects end to end: from problem formulation to prototype to results at scale, and turn them into real-time demos and deployable systems
· Hands-on research: implement, train and optimize models
· Mentor junior researchers, co-supervise interns
· Work with the systems stream and engineering teams to profile and accelerate models on large NPU/GPU clusters
· Publish at top venues (CVPR, ICCV/ECCV, NeurIPS, ICLR, ICML, SIGGRAPH, MLSys) and contribute to open-source projects
· Define benchmarks and metrics for quality, latency (real-time factor) and cost at scale
· Represent the team in technical reviews, at conferences and in workshops
What We Are Looking For
· PhD in Computer Science, Electrical Engineering, Artificial Intelligence, Machine Learning or a related field, with at least 5 years of research experience after the PhD in academia or industry
· Strong publication record at top venues in generative AI, computer vision, multimodal AI or efficient ML, including first-author papers
· Hands-on experience with diffusion, flow-matching or other large generative models (multi-billion parameters)
· Demonstrated, measurable gains in model efficiency (latency, memory or cost), for example through distillation, sparse attention, token reduction or quantization
· Experience leading research projects and mentoring researchers or students
· Experience with large-scale distributed training or inference
· Strong programming skills in Python and PyTorch; C++ is an advantage
· Clear communication, in writing and in talks
Experience in one or more of the following areas is an advantage:
· Video generation, streaming or autoregressive video, or world models
· Token merging or pruning, adaptive tokenization, or positional encodings for multi-resolution inputs
· Step distillation, sparse or efficient attention, quantization
· MoE models
· KV cache optimization and long-context modeling
· Profiling and optimizing models on NPUs or GPUs
· RL or preference optimization for generative models
· Open-source AI projects
· Supervising PhD students or building academic collaborations
What We Offer
· The opportunity to shape the research directions of a growing research stream
· Hands-on research on Multimodal AI, Video Generation, World Models and Efficient AI
· Close collaboration with researchers and engineers from leading universities, research institutions and industry teams
· Access to large-scale AI models and advanced AI computing platforms
· Support for publishing, open-source contributions and conference attendance
· The opportunity to mentor researchers and supervise interns and PhD students
· A highly international research environment in Europe
Who We Are Looking For
We are particularly interested in researchers who are not only excited about making AI models smarter, but who want to answer:
· How can we make large multimodal models faster, more scalable and more efficient, and run them in real time on real hardware?
If you want to lead hands-on research on efficient Multimodal AI and Video Generation, we would love to hear from you.
- Department
- Computing Product Line
- Location
- Zürich