Skip to content

Scraper needs update: Bandersnatch stores dists differently now #17

@awwad

Description

@awwad

Bandersnatch (which is what I assume has been used to generate a local mirror of PyPI for users using the scraper for --local execution) has changed in the past few months (somewhere between 1.7 and 1.11, I think). Bandersnatch no longer puts source distributions into directories of the form:
/srv/pypi/web/packages/<firstletter>/<packagename>/<packagename>-<version>.tar.gz

They are now in:
/srv/pypi/web/packages/<irrelevantstring>/<irrelevantstring>/<irrelevantstring>/<packagename>-<version>.tar.gz

Bits of the scraper for --local execution need to be updated, and I need to be careful not to wreck package name & version recognition (because of dashes in package names, for example). /: The relevant thing here is that I no longer have a parent directory name that identifies the package clearly without the ambiguity of version strings.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions