As a Software Development Engineer (SDE) at the Generative AI Innovation Center at AWS, you will embark on an exciting journey to develop custom Large Language Models (LLMs) that empower businesses with transformative AI solutions. Your work will have a significant impact on optimizing AI models for high-performance deployment, enabling customers to harness cutting-edge technology. Collaborating with a diverse team of experts, you will thrive in an inclusive culture that values innovation and continuous learning.
You'll be responsible for
🔧
Designing and implementing training pipelines
Design and implement distributed training pipelines for Large Language Models (LLMs) using tools such as Fully Sharded Data Parallel (FSDP) and DeepSpeed, ensuring scalability and efficiency.🎨
Customizing and fine-tuning LLMs
Adapt LLMs for new languages, domains, and vision applications through continued pre-training, fine-tuning, and Reinforcement Learning with Human Feedback (RLHF).🚀
Optimizing models for AWS
Optimize AI models for deployment on AWS's custom AI accelerators, enhancing performance and efficiency.Skills you'll need
🤖
Deep learning and machine learning methods
Hands-on experience with deep learning and/or machine learning methods for training, fine-tuning, and inference.🧠
Generative AI technology
Hands-on experience with generative AI technology, including developing, deploying, or optimizing machine learning models.💻
Software development life cycle
Experience with the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.View more