Skip to content

[Draft] Support BulkPipeline operation for multi-model execution#16281

Open
batcheu wants to merge 3 commits intoSamsung:masterfrom
batcheu:draft/trix_pipeline
Open

[Draft] Support BulkPipeline operation for multi-model execution#16281
batcheu wants to merge 3 commits intoSamsung:masterfrom
batcheu:draft/trix_pipeline

Conversation

@batcheu
Copy link
Contributor

@batcheu batcheu commented Nov 11, 2025

This is draft PR for BulkPipeline operation which is extended version of Bulk with multiple TRIX models.


This replaces the previous NYI exception with actual pipeline
execution functionality for the trix backend.

ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
This commit adds buffer sharing mechanism to reduce memory usage
in bulk pipeline execution.
Link models for async buffer preparation and optimize execution
performance when models have identical program and weight sizes.

ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
This commit adds verification step to ensure loaded models have
matching input/output counts with the pipeline configuration.

ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments