feat: add pipelines v1 #476

luxass · 2026-01-19T05:51:59Z

🔗 Linked issue

📚 Description

changeset-bot · 2026-01-19T05:52:05Z

⚠️ No Changeset found

Latest commit: 72a6d16

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

coderabbitai · 2026-01-19T05:52:25Z

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

🔍 Trigger a full review

✨ Finishing touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Post copyable unit tests in a comment
Commit unit tests in branch feat/pipelines-v1

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

packages/pipelines/pipeline-presets/src/parsers/unicode-data.ts

+
+    if (characterName.endsWith(", First>")) {
+      rangeStart = codePoint;
+      rangeName = characterName.replace(", First>", "").replace("<", "");


In general, to avoid incomplete escaping or cleaning when using String.prototype.replace, use a global regular expression (/.../g) or another method that processes all occurrences (e.g., split/join) instead of passing a plain string, which only affects the first occurrence.

Here, the goal is to normalize rangeName by stripping the trailing ", First>" marker and removing all < characters from the remaining name. The current code:

if (characterName.endsWith(", First>")) { rangeStart = codePoint; rangeName = characterName.replace(", First>", "").replace("<", ""); continue; }

only removes the first <. The most direct, non-functional-change fix is to change the second .replace to use a global regular expression:

rangeName = characterName.replace(", First>", "").replace(/</g, "");

This preserves the existing behavior for typical inputs (with a single <), but correctly handles any unexpected extra < characters. No new imports or helpers are needed, and the change is localized to line 48 in packages/pipelines/pipeline-presets/src/parsers/unicode-data.ts.

packages/pipelines/pipeline-presets/src/routes/common.ts

github-actions · 2026-01-19T05:54:11Z

🌏 Preview Deployments

Application	Status	Preview URL
API	⏳ In Progress	N/A
Website	⏳ In Progress	N/A
Documentation	⏳ In Progress	N/A

Built from commit: 483558979674341c86d594785cb093ce445ef126

_{🤖 This comment will be updated automatically when you push new commits to this PR.}

packages/pipelines/pipeline-executor/test/executor.test.ts

+  });
+
+  it("should accept pipelines and optional artifacts", () => {
+    const pipeline = definePipeline({


- Created `README.md` for documentation. - Added `package.json` with dependencies and scripts. - Configured TypeScript with `tsconfig.json` and `tsconfig.build.json`. - Set up `tsdown` for building the package. - Updated `pnpm-lock.yaml` to include new package dependencies. - Modified `pnpm-workspace.yaml` to include all packages under `packages/**`.

- Introduced `standard.ts` for parsing standard Unicode data. - Added `unicode-data.ts` for parsing detailed Unicode character metadata. - Created pipelines for basic, emoji, and full Unicode data processing. - Implemented resolvers for grouped and property JSON outputs. - Added various transforms including deduplication, range expansion, and filtering. - Established HTTP and memory sources for data retrieval. - Configured TypeScript settings for building and testing.

Modified the `build` and `dev` script filters in `package.json` to use double asterisks (`**`) for better matching of package directories.

Updated `@luxass/eslint-config` from version `7.0.0-beta.1` to `7.0.0-beta.2` for improved linting rules. Added `tinyglobby` package at version `0.2.15` to enhance globbing capabilities in the project.

- Updated `definePipeline` to use `Omit` for better type safety. - Adjusted type inference tests to validate expected types. - Added `definePipelineRoute` to the playground example for improved routing functionality.

- Introduced `vitest-testdirs` in `package.json` for improved testing capabilities. - Added comprehensive tests for pipeline file handling in `loader.test.ts`.

Refactor `findPipelineFiles` to accept an options object for improved flexibility. Update related function calls throughout the codebase to use the new structure.

github-advanced-security bot found potential problems Jan 19, 2026

View reviewed changes

github-code-quality bot found potential problems Jan 19, 2026

View reviewed changes

packages/pipelines/pipeline-presets/src/routes/common.ts Fixed Show fixed Hide fixed

packages/pipelines/pipeline-presets/src/routes/common.ts Fixed Show fixed Hide fixed

luxass requested a deployment to apps-approval January 19, 2026 05:54 — with GitHub Actions Waiting

github-code-quality bot found potential problems Jan 20, 2026

View reviewed changes

packages/pipelines/pipeline-executor/test/executor.test.ts

});

it("should accept pipelines and optional artifacts", () => {

const pipeline = definePipeline({

luxass force-pushed the feat/pipelines-v1 branch from 9bc07f8 to 1f887f7 Compare January 21, 2026 19:04

luxass force-pushed the feat/pipelines-v1 branch from 1f887f7 to 908f584 Compare January 31, 2026 16:26

luxass added 11 commits January 31, 2026 17:27

feat(pipelines): implement cache key and store interfaces

f8af276

WIP

720cc33

chore: add ESLint configuration files

799fb75

chore: lint

7285c4e

chore: lint

ff1138b

chore: update build and dev script filters

54795b0

Modified the `build` and `dev` script filters in `package.json` to use double asterisks (`**`) for better matching of package directories.

chore: update eslint config to beta.2 and add tinyglobby

16f2b55

Updated `@luxass/eslint-config` from version `7.0.0-beta.1` to `7.0.0-beta.2` for improved linting rules. Added `tinyglobby` package at version `0.2.15` to enhance globbing capabilities in the project.

WIP

bbd5107

feat: enhance pipeline definition options and type inference

e3a429c

- Updated `definePipeline` to use `Omit` for better type safety. - Adjusted type inference tests to validate expected types. - Added `definePipelineRoute` to the playground example for improved routing functionality.

luxass force-pushed the feat/pipelines-v1 branch from 908f584 to e3a429c Compare January 31, 2026 16:28

luxass added 7 commits January 31, 2026 19:11

chore: remove main and module fields from package.json

e74d4f7

refactor(pipeline-loader): remove unused loadPipelines function

33fb3dc

feat(pipeline-loader): add vitest-testdirs for testing support

cbcb594

- Introduced `vitest-testdirs` in `package.json` for improved testing capabilities. - Added comprehensive tests for pipeline file handling in `loader.test.ts`.

WIP: first draft of pipeline ui

26038a3

WIP: first draft of the Pipeline Server

3698a2a

WIP: doesn't work right now. AI generated most of it.

c0622e8

refactor(pipeline-loader): update findPipelineFiles interface

72a6d16

Refactor `findPipelineFiles` to accept an options object for improved flexibility. Update related function calls throughout the codebase to use the new structure.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: add pipelines v1 #476

feat: add pipelines v1 #476

Uh oh!

luxass commented Jan 19, 2026

Uh oh!

changeset-bot bot commented Jan 19, 2026 •

edited

Loading

Uh oh!

coderabbitai bot commented Jan 19, 2026 •

edited

Loading

Review skipped

Uh oh!

Check failure

Copilot Autofix

Uh oh!

Uh oh!

github-actions bot commented Jan 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

feat: add pipelines v1 #476

Are you sure you want to change the base?

feat: add pipelines v1 #476

Uh oh!

Conversation

luxass commented Jan 19, 2026

🔗 Linked issue

📚 Description

Uh oh!

changeset-bot bot commented Jan 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ No Changeset found

Uh oh!

coderabbitai bot commented Jan 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review skipped

Uh oh!

Check failure

Copilot Autofix

Uh oh!

Uh oh!

github-actions bot commented Jan 19, 2026

🌏 Preview Deployments

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

changeset-bot bot commented Jan 19, 2026 •

edited

Loading

coderabbitai bot commented Jan 19, 2026 •

edited

Loading