Job Title: AI Compiler Engineer

Job Description:

Overview:

We are seeking a skilled and motivated AI Compiler Engineer to lead the development of our AI compiler for the Neural Processing Unit (NPU). As part of our team, you will play a critical role in transforming high-level neural network workloads (such as CNNs and transformer models) into efficient machine code that maximizes inference performance, minimizes power consumption, and optimizes memory usage.

Responsibilities:

1. Compiler Development:

• Design and develop an AI compiler that translates high-level neural network descriptions (in frameworks like TensorFlow, PyTorch, or ONNX) into optimized machine code for the NPU.

• Implement parsing algorithms to analyze neural network graphs and extract relevant information for compilation.

2. Optimization Strategies:

• Optimize the computational graph by applying techniques such as operator fusion, kernel selection, and memory layout transformations.

• Minimize inference time, reduce power consumption, and optimize memory footprint through intelligent code generation.

3. Performance Profiling and Analysis:

• Profile compiled code to identify bottlenecks and areas for improvement.

• Collaborate with hardware architects to understand NPU microarchitecture and tailor optimizations accordingly.

4. Code Generation and Lowering:

• Generate efficient machine code from the intermediate representation of neural network operations.

• Ensure compatibility with the NPU's instruction set architecture.

5. Integration and Testing:

• Integrate the AI compiler into the overall software stack, including runtime libraries and drivers.

• Develop test suites to validate correctness, performance, and compatibility across various neural network models.

6. Documentation and Communication:

• Document design decisions, algorithms, and implementation details.

• Collaborate with cross-functional teams, including hardware engineers, software developers, and researchers.

Qualifications:

• Master's or Ph.D. in Computer Science, Electrical Engineering, or a related field.

• Minimum of 3 years of experience in compiler development, preferably with exposure to AI or machine learning.

• Proficiency in C/C++/Python programming and familiarity with compiler construction.

• Knowledge of neural network frameworks (TensorFlow, PyTorch, etc.) and their intermediate representations.

• Experience with performance profiling tools and optimization techniques.

• Understanding of machine learning concepts and hardware architectures.

• Familiarity with data structures, optimization algorithms, and DevOps tools (such as Git, CI/CD pipelines).

• Strong problem-solving abilities and attention to detail.

• Excellent communication skills for collaborating with cross-functional teams.

Preferred Skills:

• Familiarity with deep learning frameworks and libraries.

• Knowledge of hardware acceleration technologies and frameworks.

• Experience of tensor computation and optimization.

• Previous work in compiler for CPU, GPU, DSP, NPU is a plus.

If you are passionate about compiler engineering, AI optimization, and want to be part of a team driving innovation, we encourage you to apply. Join us in shaping the future of AI acceleration.