Meta is seeking a Software Engineer to join our team. The ideal candidate is someone with experience working on maximizing performance of AI models on GPUs or custom silicon. This role involves applying these skills to solve some of the most crucial and exciting problems that exist on the web. The AI Applications Engineering team is dedicated to maximizing training and inference performance of Generative AI (GenAI) and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We employ innovative optimization and parallelization strategies to maximize training throughput for the next generations of GenAI and recommendation models. Additionally, we work cross-functionally with many partner teams to ensure end-to-end performance of large-scale pre-training and inference, enabling us to deliver the next generation of AI experiences more quickly to our users.Software Engineer ResponsibilitiesWork cross-functionally to co-design models to maximize pre-training and inference efficiencyApplying and driving state-of-the-art optimization techniques to our latest large-scale AI workloads running on Meta's fleet of accelerators including functional development and maintenanceProfiling, analyzing, debugging, and optimizing large-scale workloads on our next-generation training superclustersOptimization of the underlying processes of the whole vertical stack, from kernels, framework, communication, and firmware to layers and hyperparametersLead large and complex technical efforts across many engineers and teams from zero to oneMinimum QualificationsBachelor's degree in computer science or a related STEM fieldExperience programming AI accelerators (e.g. GPUs, custom silicon etc.) using AI frameworks such as PyTorch or similarExperience developing custom kernels and compiler infrastructure to improve performance using low-level programming models such as CUDA, OpenCL or similarMinimum 5+ years of experience developing and optimizing performance in modern C/C++Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employmentPreferred QualificationsExperience with training and validating large-scale AI models, including parallelising models across several acceleratorsUnderstanding of multiprocessing, including race conditions and communications between processesExperience of evaluating model performance, e.g., with profilers and tuning hyperparametersThorough understanding of model and data parallelisms such as FSDP, tensor parallelism, model parallelism, expert parallelism, etcDemonstrated experience of the model life cycle from pre-training and post-training to inference, dataset splits and shuffling, metrics, especially for large language modelsExperience of developing, optimizing and validating kernels on GPUs or other acceleratorsAbout MetaMeta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.Equal Employment OpportunityMeta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the .Apply for this jobTake the first step toward a rewarding career at Meta.APPLY NOWFind your roleExplore jobs that match your skills and experience. Search by technology, team or location to find an opening that's right for you.CareersFollow usCareer programsTeamsWorking at MetaMy accountAbout usEqual Employment OpportunityMeta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need assistance or an accommodation due to a disability, fill out the
