Machine Learning Engineer
Machine learning engineers in this role build and optimize systems that translate research models into production—spanning model serving infrastructure, inference performance tuning, and distributed training pipelines. They distinguish themselves by combining deep systems expertise with ML knowledge, working on problems like latency optimization, resource efficiency, and scaling models across heterogeneous hardware and platforms. These engineers typically sit within specialized teams focused on either search and retrieval, robotics, foundation models, or inference optimization, collaborating closely with research teams to operationalize cutting-edge architectures at scale.
Skills
What companies are looking for in this role.
Designing and implementing machine learning models for production deployment
Optimizing model inference performance for latency and throughput requirements
Building scalable distributed systems for training and serving machine learning models
Working with GPU and specialized hardware acceleration for model training and inference
Profiling and debugging performance bottlenecks in machine learning systems
Implementing and optimizing neural network architectures and training algorithms
Architecting end-to-end machine learning systems from data collection to model serving
Developing data pipelines and ETL workflows for model training and evaluation
Managing production ML systems and responding to incidents in real-time environments
Implementing monitoring, observability, and alerting systems for ML infrastructure
Leveraging large language models and foundation models for downstream applications
Building and deploying agentic AI systems and autonomous agents
Implementing retrieval-augmented generation and semantic search systems
Optimizing model quantization and compression techniques for efficient inference
Implementing reinforcement learning and alignment techniques for model training
Cross-functional collaboration with research, product, and infrastructure teams
Communicating technical decisions and providing architectural vision to stakeholders
Defining and measuring quality metrics for machine learning system performance
Breaking down complex, open-ended problems into manageable engineering strategies
Mentoring junior engineers and promoting best practices in machine learning development
Technology
The tools and technologies that define this role.
Open Jobs
283 open Machine Learning Engineer jobs across 56 companies.
Other Engineering roles
General-purpose software engineering roles focused on building and maintaining software systems. Covers generalist SWE positions that don't clearly fall into frontend, backend, fullstack, or other specialized tracks.
Engineers focused on server-side systems, APIs, services, and data processing pipelines. Includes roles explicitly labeled as backend or server-side development.
Engineers specializing in user-facing interfaces, web applications, and client-side development. Includes UI/UX engineering and web development roles.
Engineers working across the entire application stack, handling both frontend and backend responsibilities.
Engineers building and maintaining internal platforms, cloud infrastructure, compute systems, and developer tooling.