Software Development Engineer - Agentic AI / ML Infrastructure

Our client is seeking a Software Development Engineer to join their team. As a Software Development Engineer, you will be part of a senior individual contributor effort supporting agentic AI / ML infrastructure work across the software stack. The ideal candidate will have a strong drive to deliver production-grade Python systems, the ability to debug distributed GPU workloads with evidence-based analysis, and the confidence to own complex components end-to-end while collaborating with technical leads and partner teams.

Job Title: Software Development Engineer - AI / ML

Location: California, CA (Remote)

Pay Range: $90 

Visa sponsorship not available

What's the Job?

• Architect and implement Python agent frameworks, including tool adapters, orchestration loops, structured outputs, session handling, and production-ready CLI or service interfaces.
• Build LLM-powered workflows using frameworks such as LiteLLM, DSPy, or equivalent, with bounded prompts, allowlisted tools, budget caps, structured JSON outputs, and evidence-backed reporting.
• Integrate agents with the AMD GPU and ML software ecosystem, including ROCm tooling, PyTorch, distributed training and inference stacks, profilers, cluster metrics, log pipelines, and debug utilities.
• Own quality and evaluation infrastructure, including fixture-driven tests, JSON Schema validation, regression suites, accuracy metrics, and CI integration prior to rollout.
• Solve ML operations challenges on training and inference clusters, including multi-node failure analysis, performance regression investigation, configuration and launch issues, and operational automation.

What's Needed?

• Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field; equivalent practical experience accepted.
• 10+ years of professional software engineering experience, including 5+ years developing production Python systems at scale.
• Deep experience with distributed ML training or inference on GPU clusters, including multi-node jobs, collective communication failures, and log/metric correlation across ranks and nodes.
• Strong hands-on experience with PyTorch and production familiarity with large-scale stacks such as Megatron-LM, DeepSpeed, TorchTitan, vLLM, or equivalent.
• Proven ML debugging and performance engineering experience across throughput regressions, memory errors, numerical instability, misconfiguration, and profiler/trace analysis.

What's in it for me?

• Opportunity to build production-grade intelligent agents that reduce manual toil in ML operations.
• Senior ownership of end-to-end components, from design and implementation to evaluation and rollout readiness.
• Hands-on impact across training and inference clusters, including distributed failure investigation and performance regression work.
• Collaboration with framework, performance, and field teams to incorporate feedback and iterate based on production and pilot learnings.
• Clear delivery expectations, including deployment-ready artifacts such as Docker/Kubernetes packaging, runbooks, and documentation.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.