NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI and enabled the next era of computing. NVIDIA is a “learning machine” that constantly evolves by adapting to new opportunities that are hard to address, that matters to the world, and that only we can address. This is our life’s work, to amplify human imagination and intelligence, and expand what is possible. We’re seeking strategic, bold, hard-working, and creative individuals who are passionate about helping us tackle challenges no one else can solve. Make the choice to join us today.
We are looking for a n AI Infrastructure System Software Manager to join our mission to continue improving our HPC infrastructure. Our team builds and operates sophisticated infrastructure to enable business critical services and AI applications. You will be working with a team of passionate and skilled engineers that are continuously working to provide better tools to build and manage this i nfras tru cture . Ideal candidate is strong in software development, designing and creating reliable distribute d system s, and has the abi lit y to imp leme n t well though t out lo ng term maintenance strategy.
What you'll be doing:
Mentor, grow, and develop a world-class team of AI infrastructure engineers.
Work across several teams and orgs to build products that use LLMs and agent systems to serve the needs of NVIDIA engineering teams. In that role, you will be collaborating with research and infra teams and serve a large user base (hardware/software teams across NVIDIA).
Align priorities across collaborators and define metrics for measuring the success of the product/team.
Develop and execute strategies for scalable, reliable, and secure AI infrastructure supporting both research and production workloads.
Ensure robust monitoring, logging, visualization, and alerting capabilities to guarantee promised uptime and operational excellence.
Architect, design, develop, and maintain infrastructure and large-scale applications for LLM-based solutions. Optimize these systems for performance, scalability, reliability, and secure data management.
Stay updated with the latest trends in AI, ML, and infrastructure, proactively seeking opportunities to integrate advancements into Nvidia’s LLM and AI infrastructure solutions.
What we need to see:
10+ overall years of industry large distributed system software development experience.
BS+ degree in CS or related/equivalent experience.
5+ years of experience managing of AI and SW development teams.
Familiarity with modern software development stacks and tools, including containerization, cloud or on-premises deployments, API integration for seamless model operation, and real-time processing frameworks.
Experience in developing and maintaining LLM or GenAI infrastructure
Excellent communication, collaboration and problem-solving skills, with a dedication to encouraging an inclusive and diverse workplace.
Hands-on experience developing large-scale distributed systems
Ways to stand out from the crowd:
Strong technical background in cloud/distributed infrastructure
Experience debugging functional and performance issues in HPC GPU clusters
Background in running and instrumenting distributed LLM training on a multi GPU HPC cluster
Experience with HPC schedulers such as Slurm
Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 425,500 USD for Level 4.You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until July 29, 2025. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law....attitude and the ability to prioritize tasks and delegate effectively, check out our available Supervisor position and LETS MAKE SHEETZ HAPPEN! Be a leader by example to our store team members with high-energy hustle and a strong team mentality. Youll all work...
Job Description Job Description Start Date: IMMEDIATE START AVAILABLE Compensation: Base Pay + Uncapped Commission (Average reps earn $800-1200 a week) About the Role: Are you outgoing, confident, and love talking to people? Do you thrive in a fast-paced ...
...the Association of American Universities and holds a distinguished ranking in the Carnegie Classification of Institutions of Higher Education. The UO enrolls more than 20,000 undergraduate and 3,600 graduate students representing all 50 states and nearly 100 countries...
...including two endoscopy suites and an on-site ASC. With J1 and H1b visas supported, this role provides an excellent compensation... ..., and fully integrated Epic EMR Visa: J1 & H1b sponsorship available Located in central Florida, this location offers a charming...
...and Riverside County by writing articles that analyze policy, criminal justice issues, and immigration rights, while equipping our people... ...students currently in or pursuing law school and other graduate degrees who care about your long-term growth. Experience working...