Job Description

We are now looking for a Senior Machine Learning Engineer for Quantized Training.NVIDIA is seeking machine learning engineers to support next-generation recipes for mixed-precision training. In this role you will (1) distill LLM research literature into its core, (2) translate literature into experiments at scale, (3) create insights to support or refute the efficacy of a technique, and (4) generate reproducible training recipes.What you'll be doing:Review state-of-the-art literature in quantized trainingBuild robust, reproducible, and portable training recipesProvide engineering support to customers using HW and SW approachesCollaborate closely with hardware, software, and research teams to assess and adopt deep learning algorithmic advancements in quantizationWork with production SW teams to realize recipes in production workflowsWhat we need to see:Experience with PyTorch or similar frameworks such as jax/xla/etcProficient in the math of machine learningFamiliarity with FP8 for trainingPublished research or significant contributions to the field of AI, particularly in algorithm development for hardware-software co-designPhD, M.S. degree or equivalent experience in Computer Science or a related field5+ YoE working in ML / AIStrong written and oral communication skillsStrong programming skills and ability to debug ML systemsWays to stand out from the crowd:Experience in LLM training, fine-tuning and optimization (quantization, sparsity)Familiarity with MX formats for trainingExperience with Transformer Engine, Megatron-LM, or NeMoGPU computing is the most productive and pervasive platform for deep learning and AI. It begins with the most advanced GPUs and the systems and software we build on top of them. We integrate and optimize every deep learning framework. We work with the major systems companies and every major cloud service provider to make GPUs available in data centers and in the cloud. We craft computers and software to bring AI to edge devices, such as self-driving cars and autonomous robots. AI has the potential to spur a wave of social progress unmatched since the industrial revolution.NVIDIA is widely considered to be one of the technology world’s most desirable employers. This opportunity offers you the ability to collaborate with some of the most forward-thinking and hard-working people in the world, shaping the future of AI in a creative and autonomous work environment that encourages innovation. Do you love the challenge of influencing the long-term opportunities that expand NVIDIA’s impact on the datacenter and beyond? If so, we want to hear from you!The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, WA, Seattle; US, CA, Santa ClaraType: Full time Nvidia

Job Tags

Similar Jobs