PhD in Communication-Optimized Inference in Large Language Models

Introduction

Are you interested in the communication networks behind modern AI systems? Would you like to combine mathematical modeling with experiments on programmable network hardware to make AI infrastructure faster and more energy-efficient? In this PhD project, you will develop models and orchestration methods for the networks that connect GPUs during large language model inference. Are you our next PhD candidate in high-performance AI networking?

Job Description

Your research challenge

Large language models rely on powerful computing infrastructure to generate responses. When inference is distributed across multiple GPUs, these devices must continuously exchange intermediate results. Network congestion and communication overhead can therefore limit performance and increase energy consumption, even when substantial computing resources are available.

In the project Communication-Optimized Inference in Large Language Models (COIL) , you will investigate how analytical network models can support the design and operation of AI clusters. The project combines network performance modeling, optimization, and experimental research, giving you the opportunity to connect mathematical foundations with practical challenges in AI infrastructure.

You will develop fast, composable analytical models using Network Calculus, a mathematical framework for analyzing communication networks. These models will capture interactions between inference traffic, network architecture, and mechanisms such as flow control and congestion feedback. They will provide bounds on communication latency and buffer requirements, complemented by energy estimates based on measurement-calibrated power models.

Building on these models, you will explore how architectural choices—including network topology, link bandwidth, and parallelization strategies—affect performance and energy consumption. You will develop tools that help cluster designers evaluate promising configurations efficiently.

You will also investigate how the models can guide runtime decisions, such as workload placement, prioritization, routing, or resource reservation. A focused prototype will demonstrate how model-informed decisions can improve the operation of an existing network.

Experimental validation will be an integral part of your research. You will use measurements from AI infrastructure and conduct reproducible experiments on programmable networking testbeds. Technologies of interest include Ethernet-based AI networks, emerging Ultra Ethernet mechanisms, P4-programmable switches, and SmartNICs. Finally, you will evaluate the results from the testbeds on real AI infrastructure in collaboration with our partner SURF .

Through this combination of theory, software development, and experimentation, you will contribute to more responsive and energy-efficient AI infrastructure. The project also offers opportunities to share your findings with networking standardization communities and to release research tools and experimental results openly.

An interdisciplinary and international environment

You will conduct your research under the main supervision of Prof. Lisa Maile who leads the Network Modeling and Design (NoMaD) lab. NoMaD is part of the Electronic Systems group in the Department of Electrical Engineering at Eindhoven University of Technology. Your supervision will also include partners from the Advanced Models by Open Research and Engineering (AMOR/e) Lab of Computer Science and the Model-Based Design Lab from Electrical Engineering.

The position is funded through the EuroTech programme, which promotes research collaboration between leading technical universities across Europe. As part of this project, you will collaborate closely with Prof. Georg Carle and his research group on Network Architectures and Services at the Technical University of Munich (TUM) . As part of this collaboration, you will spend six-month in Munich with the group at TUM , where you will gain hands-on experience with programmable network hardware and reproducible experimental infrastructure.

Job Requirements

Essential qualifications

• A master’s degree in Electrical Engineering, Computer Science, Computer Engineering, Applied Mathematics, or a closely related field.
• A strong mathematical background, demonstrated by excellent performance in mathematically rigorous courses, additional mathematics electives, a mathematics minor or specialization, or substantial mathematical work in a thesis or research project.
• Good programming skills and an interest in developing research software and experimental tools.
• Strong analytical and problem-solving skills, initiative, and creativity.
• An interest in high-performance networking and AI infrastructure, and motivation to apply mathematical methods to computer networks and distributed systems.
• A strong team spirit and enthusiasm for working in an international, collaborative, and socially engaging environment.
• Excellent oral and written communication skills in English.
• Willingness to spend at least six months at the Technical University of Munich (TUM) as part of the project.

Desirable qualifications

• A solid foundation in computer networks or distributed systems.
• Experience with Network Calculus, network simulation, mathematical optimization, or GPU communication.
• Experience with programmable networking technologies, such as P4 or SmartNICs.

Selection procedure

Interviews and a scientific presentation will be part of the selection procedure.

Conditions of Employment

A meaningful job in a dynamic and ambitious university, in an interdisciplinary setting and within an international network. You will work on a beautiful, green campus within walking distance of the central train station.

In addition, we offer you

• Full-time employment for four years, with an intermediate assessment after nine months. You will spend a minimum of 10% of your four-year employment on teaching tasks, with a maximum of 15% per year of your employment.
• Salary and benefits (such as a pension scheme, paid pregnancy and maternity leave, partially paid parental leave) in accordance with the Collective Labour Agreement for Dutch Universities , scale P (min. € 3,204 - max. € 4,051 gross base salary per month (full-time)).
• In addition to your base salary, you will receive an 8% holiday allowance and an 8.3% year-end bonus, both calculated based on your annual gross base salary.
• Generous leave options: a standard 29 days (based on a 38 hour working week) per year that you can increase to 41 days by working two hours more per week (flexible working hours). This is prorated if you work part-time.
• As a TU/e employee, you participate in the ABP pension scheme, providing retirement pension and pension benefits for surviving dependents and occupational disability. TU/e pays 70% of the pension premium, while employees contribute the remaining 30%.
• High-quality training programs and other support to grow into a self-aware, autonomous scientific researcher. At TU/e we challenge you to take charge of your own learning process .
• An excellent technical infrastructure, and on-campus children's day care.
• Unlimited access to the modern on‑campus TU/e Student Sports Center at an exceptionally affordable rate.
• We support your wellbeing with free 24/7 access to OpenUp, providing you and your family with mental health support, expert guidance, and online training.
• An allowance for commuting, working from home and internet costs.
• A Staff Immigration Team and a tax compensation scheme (the Expat Scheme ) for international candidates.

On our website you can discover even more information about our conditions of employment . Build on your career at TU/e!

About us

We are a leading international university where scientific curiosity meets a hands-on mindset. We work in an open and collaborative way with high-tech industries to tackle complex societal challenges. Our responsible and respectful approach ensures impact — today and in the future. TU/e is home to over 13,000 students and more than 7,000 staff, forming a diverse and vibrant academic community. Discover what Light Up means to TU/e in our short company video .

Our university is located in Brainport Eindhoven — a world‑leading tech region with more than 7,000 high‑tech companies and strong R&D activity. Known for breakthroughs in AI, photonics, semiconductors and advanced manufacturing, Brainport is a place where technology serves people and society. Learn more about the Brainport region here .

The Network Modeling and Design (NoMaD) Lab develops mathematical models, tools, and protocols for reliable and efficient communication networks. Its research connects formal analysis with practical implementation, covering technologies such as Time-Sensitive Networking, Ultra Ethernet, and beyond-5G networks. Applications range from connected vehicles and industrial automation to large-scale AI infrastructure. By combining analytical methods with simulation and hardware experiments, the lab translates theoretical insights into practical network designs and resource-management solutions.

NoMaD is part of the ES group , which develops methods for designing electronic, embedded, and cyber-physical systems with predictable performance, timing, reliability, and energy consumption. With about 12 full-time and 5 part-time professors and ~45 post-docs, PhDs, and EngD students, the group’s expertise spans model-driven engineering, system architectures, software, and digital circuits. This provides an interdisciplinary environment for your research, connecting network modeling and optimization with broader challenges in computing and system design.

The mission of the Department of Electrical Engineering is to acquire, share and transfer knowledge and understanding in the whole field of Electrical Engineering through education, research and valorization. We work towards a ‘Smart Sustainable Society’, a ‘Connected World’, and a healthy humanity (‘Care & Cure’). Activities share an application-oriented character, a high degree of complexity and a large synergy between multiple facets of the field.

Research is carried out into the applications of electromagnetic phenomena in all forms of energy conversion, telecommunication and electrical signal processing. Existing and new electrical components and systems are analyzed, designed and built. The Electrical Engineering department takes its inspiration from contacts with high-tech industry in the direct surrounding region and beyond.

The department is innovative and has international ambitions and partnerships. The result is a challenging and inspiring setting in which socially relevant issues are addressed.

Information

Do you recognize yourself in this profile and would you like to know more? Please contact the hiring manager Prof. Lisa Maile, l.t.maile@tue.nl .

Visit our website for more information about the application process . You can also contact Kevin Caris, HR advisor, k.t.caris@tue.nl .

Curious to hear more about what it’s like as a PhD candidate at TU/e? Please view the video .

Are you inspired and would like to know more about working at TU/e? Please visit our career page.

We invite you to submit a complete application by using the apply button. The application should include a:

• Cover letter in which you describe your motivation and qualifications for the position.
• Curriculum vitae, including a list of your publications and the contact information of three references. Kindly note that we may reach out to references at any stage of the recruitment process. We recommend notifying your references upon submitting your application.
• A transcript of your BSc and MSc studies.
• A sample of your academic or technical writing in English where you are the first authors. For example, a research paper, thesis chapter, or report, of which you are the primary author.

Ensure that you submit all the requested application documents. We give priority to complete applications.

We look forward to receiving your application and will screen it as soon as possible. The vacancy will remain open until the position is filled.

Please note

• You can apply online. We will not process applications sent by email and/or post.
• A pre-employment screening (e.g. knowledge security check) can be part of the selection procedure. For more information on the knowledge security check, please consult the National Knowledge Security Guidelines .
• Please do not contact us for unsolicited services.