[Draft] Support BulkPipeline operation for multi-model execution#16281
Open
batcheu wants to merge 3 commits intoSamsung:masterfrom
Open
[Draft] Support BulkPipeline operation for multi-model execution#16281batcheu wants to merge 3 commits intoSamsung:masterfrom
batcheu wants to merge 3 commits intoSamsung:masterfrom
Conversation
5ee9729 to
0860eef
Compare
0860eef to
77b0f24
Compare
This was referenced Dec 1, 2025
This was referenced Jan 7, 2026
This replaces the previous NYI exception with actual pipeline execution functionality for the trix backend. ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
This commit adds buffer sharing mechanism to reduce memory usage in bulk pipeline execution. Link models for async buffer preparation and optimize execution performance when models have identical program and weight sizes. ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
This commit adds verification step to ensure loaded models have matching input/output counts with the pipeline configuration. ONE-DCO-1.0-Signed-off-by: Jonghwa Lee <jonghwa3.lee@samsung.com>
77b0f24 to
784f6ea
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This is draft PR for BulkPipeline operation which is extended version of Bulk with multiple TRIX models.