Skip to content

Conversation

@amd-sriram
Copy link
Collaborator

@amd-sriram amd-sriram commented Feb 3, 2026

Motivation

Integrate a new apex extension to jit loader system. Users create a apex module with C++/CUDA source code. The user would like to easily add it to JIT. The script helps to create initial builder and loader modules to help the module integrate into JIT system.

Technical Details

Run the scripts/jit_module.py script.

The script scripts/jit_module.py creates a loader module in compatibility folder and builder module in op_builder.

More details in the readme file.

Test Plan

  • Delete existing loader and builder for a module.
  • Run the script for the module.
  • Run its unit test.
rm compatibility/fused_bias_swiglu.py
rm op_builder/fused_bias_swiglu.py
python scripts/jit_module.py fused_bias_swiglu
pip install . --no-build-isolation  
python tests/L0/run_transformer/test_fused_bias_swiglu.py

Test Result

Apex builds and the unit test passes.

Submission Checklist

@amd-sriram amd-sriram changed the title Create jit module automation Add new apex module to jit load system Feb 3, 2026
…me from the builder, update missing entries in the table in readme for adding new module in jit
@pruthvistony
Copy link

I am not sure of the request here,
@jithunnair-amd , please review this PR.

@amd-sriram amd-sriram marked this pull request as draft February 10, 2026 13:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants