Red Hat

Machine Learning Engineer, Distributed vLLM

Red Hat

Boston, MA, USA
Full-TimeDepends on ExperienceSenior LevelMasters
Job Description

Welcome to Red Hat! We are currently seeking a highly skilled Machine Learning Engineer to join our team as a Distributed vLLM. As a part of our innovative and dynamic company, you will have the opportunity to work on cutting-edge technologies and contribute to the development of our next generation products. We are looking for a talented individual who is passionate about machine learning and has a strong understanding of distributed systems. If you are a problem solver, a team player, and have a strong background in computer science and data analytics, we encourage you to apply for this exciting role.

  1. Develop and implement machine learning algorithms to improve the performance and functionality of our products.
  2. Collaborate with a team of engineers and data scientists to design and build distributed systems for our next generation products.
  3. Conduct research and stay updated on the latest advancements in machine learning and distributed systems.
  4. Analyze large datasets and use data-driven insights to improve the accuracy and efficiency of our machine learning models.
  5. Work closely with product managers and stakeholders to understand business requirements and translate them into technical solutions.
  6. Debug and troubleshoot any issues with the machine learning models and distributed systems.
  7. Develop and maintain documentation for the machine learning models and distributed systems.
  8. Participate in code reviews and provide constructive feedback to improve the overall quality of the codebase.
  9. Mentor and guide junior engineers on best practices for machine learning and distributed systems.
  10. Stay updated on industry trends and share knowledge and expertise within the team.
Where is this job?
This job is located at Boston, MA, USA
Job Qualifications
  • Strong Knowledge Of Machine Learning Algorithms And Techniques: A Machine Learning Engineer At Red Hat Should Possess A Deep Understanding Of Various Machine Learning Algorithms, Such As Linear Regression, Decision Trees, And Neural Networks. They Should Also Have Experience With Relevant Libraries And Frameworks, Such As Tensorflow And Pytorch.

  • Extensive Experience With Distributed Systems: As A Distributed Vllm Engineer, The Candidate Should Have A Strong Background In Designing And Implementing Distributed Systems. They Should Be Familiar With Concepts Such As Load Balancing, Fault Tolerance, And Data Partitioning.

  • Proficiency In Programming Languages: The Ideal Candidate Should Have A Strong Programming Background In Languages Such As Python, Java, And C++, Along With Experience In Working With Large Datasets And Implementing Machine Learning Models.

  • Familiarity With Cloud Computing And Containerization: With Red Hat's Focus On Open-Source Technologies, A Machine Learning Engineer Should Have Experience With Cloud Computing Platforms Such As Aws, Azure, Or Gcp. Knowledge Of Containerization Technologies Such As Docker And Kubernetes Is Also Essential.

  • Strong Analytical And Problem-Solving Skills: As A Machine Learning Engineer, The Candidate Should Have A Strong Analytical Mindset And The Ability To Solve Complex Problems Using Data-Driven Approaches. They Should Be Able To Identify And Address Potential Issues In The Deployment And Performance Of Machine Learning Models.

Required Skills
  • Data Analysis

  • statistical analysis

  • Big Data

  • Deep Learning

  • Cloud Computing

  • Natural language processing

  • Algorithm development

  • Predictive modeling

  • Parallel programming

  • Neural Networks

  • image recognition

Soft Skills
  • Communication

  • Customer Service

  • Leadership

  • Time management

  • flexibility

  • Teamwork

  • collaboration

  • Adaptability

  • Problem-Solving

  • Decision-making

Compensation

According to JobzMall, the average salary range for a Machine Learning Engineer, Distributed vLLM in Boston, MA, USA is $120,000 - $160,000 per year. This may vary depending on factors such as the company, experience level, and specific job responsibilities. Additionally, location, industry, and education level may also impact the salary range for this position.

Additional Information
Red Hat is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
Required LanguagesEnglish
Job PostedJune 1st, 2026
Apply BeforeJuly 1st, 2026
This job posting is from a verified source. 

Apply with Video Cover Letter Add a warm greeting to your application and stand out!

About Red Hat

Red Hat, Inc. is an American multinational software company providing open-source software products to the enterprise community. Founded in 1993, Red Hat has its corporate headquarters in Raleigh, North Carolina, with other offices worldwide. It became a subsidiary of IBM on July 9th, 2019.

Frequently asked questions

Get interviewed today!

JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.

Get Started