NewMCP: Let an AI agent help you find your next job

Software Co-Design AI HPC Systems

Microsoft AI🏢 HybridMountain View, USA$119,800–$234,700 / year✦ AI skills
Apply on Microsoft AI

The team architects, co-designs, and productionizes next-generation AI systems at datacenter scale, working across models, systems software, networking, storage, and AI hardware to optimize performance, efficiency, reliability, and cost. The role sits at the boundary between exploration and production, collaborating with internal infrastructure, hardware, compiler, and product teams as well as external partners, and emphasizes rapid ideation, prototyping, and disciplined execution. The team contributes to research and engineering communities and regularly publishes, prototypes, and open-sources technologies where appropriate. MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within specified distances of that location.

✦ AI skillsThis role asks for AI & agentic skills, exactly what we teach at Into Design Systems

What you'll do

  • Lead co-design of AI systems across hardware and software boundaries, including accelerators, interconnects, memory systems, storage, runtimes, and distributed training/inference frameworks.
  • Drive architectural decisions by analyzing real workloads, identifying bottlenecks across compute, communication, and data movement, and translating findings into system and hardware requirements.
  • Co-design and optimize parallelism strategies, execution models, and distributed algorithms to improve scalability, utilization, reliability, and cost efficiency of large-scale AI systems.
  • Develop and evaluate what-if performance models to project system behavior under future workloads, model architectures, and hardware generations to guide hardware and platform roadmaps.
  • Partner with compiler, kernel, and runtime teams to unlock full performance of current and next-generation accelerators through custom kernels, scheduling, and memory optimizations.
  • Influence and guide AI hardware design at system and silicon levels, including accelerator microarchitecture, interconnect topology, memory hierarchy, and system integration trade-offs.
  • Lead cross-functional efforts to prototype, validate, and productionize high-impact co-design ideas across infrastructure, hardware, and product teams.
  • Mentor senior engineers and researchers, set technical direction, and raise systems rigor, performance engineering, and co-design thinking across the organization.

What they're looking for

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Proven background in one or more of: AI accelerator or GPU architectures; distributed systems and large-scale AI training/inference; high-performance computing (HPC) and collective communications; ML systems, runtimes, or compilers; performance modeling, benchmarking, and systems analysis; hardware–software co-design for AI workloads.
  • Proficiency in systems-level programming (e.g., C/C++, CUDA, Python) and performance-critical software development.
  • Proven ability to work across organizational boundaries and influence technical decisions involving multiple stakeholders.
  • Experience designing or operating large-scale AI clusters for training or inference.
  • Deep familiarity with LLMs, multimodal models, or recommendation systems, and their systems-level implications.
  • Experience with accelerator interconnects and communication stacks (e.g., NCCL, MPI, RDMA, high-speed Ethernet or InfiniBand).

Summary written by Into Design Systems from the public job posting, without guarantee of accuracy or completeness. Always verify the details and apply on the company's official page.

AI Design Conference 2027 online on March 10 and 11 2027

Learn the AI skills this role asks for

  • ✦ LLMsHow to get started with local LLMs as a designer:setup and real use casesDirk Bahrenburg

Sessions cover agentic design systems, Claude Code, Cursor, MCP and vibe coding workflows. Speakers come from Anthropic, OpenAI and Netflix

Get your conference ticket
AI Design Systems Conference 2026 recordings

Learn the AI skills this role asks for

  • ✦ LLMsMachine-Readable Design Systems for MCP and LLMsDiana Wolosin
Get all 15 recordings for $599
MCP server

Am I a fit for this role?

Let your own agent answer that. Connect this board once with the command below and the agent reads this posting in full instead of guessing from the title.

claude mcp add --transport http ids-jobs https://jobs.intodesignsystems.com/mcp

Then paste this and add your background

Use the ids-jobs MCP server and read the job "microsoft-ai-software-co-design-ai-hpc-systems-1v8cmo". Tell me which requirements I already meet and which ones I am missing. My background:
How the MCP server works

Related Design System roles

Hiring for a role like this?

What a featured role gets compared to a role we found ourselves

Role we found ourselves

  • Sits in the list by posting date
  • No logo and no badge
  • Nothing goes out to the community

Featured role

  • Pinned above every other role for 30 days with your company logo
  • Posted from both Into Design Systems pages on LinkedIn
  • Sent out in the Design Systems jobs email
Feature your role for $499