Internal-Error-Dynamic-Scan pipeline errors seem to have skyrocketed again recently.

[DandelionSprout]

Comparing the number of open PRs at https://github.com/microsoft/winget-pkgs/pulls?q=is%3Apr+is%3Aopen+label%3AInternal-Error-Dynamic-Scan, with the number of all open PRs, indicate between ⅓ and ¼ of submissions at any given time have run into that error. (At the time of writing it was 119/449).

The pipeline problem probably needs to get looked into at some point.

[KarbitsCode]

It is a known problem and they are aware of this:

[UnownPlain]

Updates for anyone here:

[DandelionSprout]

• "I'm also reaching out to GitHub folks to see what they suggest in terms of anything we can do to reduce the size of the repository."

I could have come up with several methods, for instance a cap of max 15 versions per package, as I've seen a handful that reached into the triple-digits; or by removing the various # Created with (...) headers that are in almost all files in all manifests. But any of my ideas would've involved ≥30,000 PRs, unfortunately.

[UnownPlain]

Removing old versions and headers wouldn't do anything reduce the size of the repo because the deleted files and headers are still stored in Git history. History would need to rewritten to completely remove the files, which is undesirable.

[ItzLevvie]

/cc @DandelionSprout: vim.vim does not seem to be an issue right now. It consumes very less space compared to other manifests. Most of the storage space within the manifests folder is being consumed by manifests\m\Mozilla\Firefox and manifests\m\Mozilla\Thunderbird

.git folder being rewritten would also require open PRs to be up-to-date with the latest commit history because of merge conflicts between the old and new commit history.

[DandelionSprout]

I've run the maths on Firefox too (Standard + ESR + DevEd) now based on this feedback, and landed on 24,421, ±4,000.

So even if we entirely discard any factor of space saving and that I concede on that entirely, 20,000〜30,000 manifests are still too many. That last part remains true.

[Dvd-Znf]

Most of the storage space within the manifests folder is being consumed by manifests\m\Mozilla\Firefox and manifests\m\Mozilla\Thunderbird

oh wow, firefox and thunderbird really are like one fifth of the whole repo xd