Network Engineer
Network Engineers in AI companies design and operate the critical infrastructure that keeps training clusters, inference pipelines, and global services running at scale. Day-to-day work spans configuring high-performance backbone networks, automating deployments across distributed data centers, and troubleshooting latency-sensitive systems that power large language models and generative AI products. What distinguishes this role from traditional IT networking is the focus on extreme scale—managing 100k+ GPU clusters, optimizing RoCEv2 and NCCL performance, and balancing hyper-growth infrastructure needs with automation-first operations using Python and Ansible. These engineers typically sit within infrastructure or platform teams that report to VP-level engineering leadership, working closely with ML systems engineers, cloud platform teams, and security groups to ensure networks meet both performance and compliance requirements for real-time AI inference and training workloads.
Skills
What companies are looking for in this role.
Designing and implementing scalable campus and enterprise network infrastructure including LAN, WAN, and VPN systems
Developing network automation solutions and infrastructure-as-code for deployment and configuration management
Configuring and optimizing routing protocols and security protocols for reliable network operations
Monitoring network performance, analyzing traffic patterns, and troubleshooting complex network issues
Writing automation scripts and tools to improve operational efficiency and reduce manual engineering tasks
Designing and implementing network security strategies, frameworks, and zero-trust architecture
Managing vendor relationships with telecommunications providers and cloud service providers
Implementing observability, monitoring dashboards, and proactive alerting systems for network infrastructure
Conducting capacity planning, forecasting growth, and driving technology roadmap decisions
Troubleshooting TCP/IP and transport layer issues in complex distributed systems
Leading physical network deployment, site commissioning, and validation testing for new data centers
Implementing DNS infrastructure and cloud VPC connectivity solutions
Architecting high-performance data center and backbone network infrastructure for GPU clusters and AI workloads
Designing network solutions for specialized hardware environments including GPUs and high-performance computing clusters
Optimizing low-latency, high-bandwidth networks for distributed machine learning and AI training operations
Designing and deploying edge networking infrastructure including peering, transit routing, and content delivery
Collaborating across cross-functional teams to align network infrastructure with business requirements
Participating in on-call rotation and providing 24/7 incident response and network operations support
Establishing governance processes, change control procedures, and architectural documentation standards
Mentoring junior engineers and establishing best practices for network operations and incident response
Technology
The tools and technologies that define this role.
Open Jobs
16 open Network Engineer jobs across 8 companies.
Other Infrastructure & IT roles
Provides end-user technical support including hardware, software, and account troubleshooting.
Designs, deploys, and maintains enterprise IT systems including identity management, SaaS platforms, device management, and business applications. The IT-facing systems engineer managing corporate technology.
Manages core IT infrastructure including servers, storage, virtualization, and cloud platforms.
IT professionals who remotely manage servers, operating systems, hypervisors, and software within data center environments. Focuses on systems administration, monitoring, patching, and troubleshooting at the OS and application layer — NOT physical hardware installation.
Implements and manages security infrastructure including IAM, endpoint security, SIEM, and security tooling. Operates within IT or infrastructure teams to protect the corporate environment.