AI Frameworks Engineer

The Role and Impact

Intel is building the open software stack that makes large language models run fast on Intel GPUs. You will join the engineering team that develops and optimizes LLM inference frameworks - working directly in vLLM and in the GPU kernel libraries beneath it, upstream and in the open. This is a deeply technical, inward-facing engineering role: your work is the framework itself. You will write and tune compute kernels, reshape execution paths, hunt performance bottlenecks down to the hardware, and land your changes in widely used open-source projects.

Business group

The Data Center Group (DCG) is at the forefront of delivering cutting-edge technologies to power the world's data centers, enabling advanced computing solutions that drive innovation across industries. Within this group, our team is dedicated to developing AI frameworks and workloads that empower researchers and developers to create high-performance, scalable solutions for complex AI challenges.

Key Responsibilities

• Design, develop, and optimize AI framework software for LLM inference on Intel GPUs, contributing upstream to external open-source frameworks such as vLLM and PyTorch.
• Develop and optimize compute kernels (e.g., Triton, SYCL) for attention, mixture-of-experts, quantization, normalization, and other core building blocks of transformer inference.
• Implement and tune distributed execution paths - tensor, pipeline, and data parallelism, collective communication, and asynchronous data movement within deep learning frameworks.
• Transform and optimize the computational-graph representation of neural network models, and develop machine learning primitives in mathematical and kernel libraries.
• Profile inference workloads to identify performance bottlenecks across the stack, quantify them, and propose and drive solutions together with the individual component teams that own each layer.
• Optimize code for a range of computing hardware backends, adapting implementations to the memory hierarchy, instruction set, and execution model of each target.
• Build and extend unit tests, correctness checks, and performance regression coverage so that framework and kernel work stays reliable as upstream moves.
• Collaborate with framework, compiler, and machine learning engineers across global teams, and engage with the open-source community through code review and technical discussion.

At Intel, employees share in successes, enjoy comprehensive rewards and are inspired by an innovative & inclusive workplace. - We guarantee you will be working in a safe environment; either at your own home or in our premises if needed. - You will have constant opportunities to develop your professional career through technical and soft skills training, taking part in innovation projects or rotational programs. - Flexible working hours. - Amazing Benefits: Stock Program, Annual and Quarterly Bonuses, Employee Pension Plan, Medical Plan and life insurance for you and your Family, Peer to peer recognition, Ticket restaurant Card, Multisport Card / Holiday card, Groups of enthusiasts, Exclusive employee discounts, (online) events and many more. - Rewards Experience @ Intel Poland: https://jobs.intel.com/pl/benefits - Total compensation package that ranks among the best in the industry. Annual Salary Range: 215 740,00 zł - 388 330,00 zł.

Minimum Qualifications

• Bachelor's degree in AI, Computer Science, Computer Engineering, Mathematics, Physics, or a related field.
• At least 2-3 years of relevant experience with a Bachelor's degree, or 1+ year with a Master's degree.
• Advanced expertise in Python programming.
• Demonstrated proficiency in PyTorch, including its internals or extension mechanisms.
• Hands-on experience with AI inference and large language models (LLMs).
• Strong problem-solving skills with experience in debugging and designing optimized software and algorithms.
• Proficiency in Linux environments from a user perspective.
• Solid foundation in AI frameworks, machine learning algorithms, and software engineering practices.

Preferred Qualification

• Experience writing or optimizing GPU compute kernels (Triton, CUDA, SYCL, OpenCL, or similar).
• Experience in performance profiling and optimization for AI workloads, including reading and interpreting hardware-level profiles.
• Familiarity with parallel and distributed computing concepts and collective communication libraries.
• Familiarity with vLLM or another LLM inference serving framework.
• Track record of accepted contributions to a major open-source AI project.
• Understanding of numerical precision and quantization formats (FP8, INT8, INT4) and their accuracy implications.
• Creativity and innovative thinking in solving technical and system-level challenges.
• Strong communication skills and ability to work across global teams.