Skip to content

Refactor/storage per session#15

Open
dushanlk wants to merge 2 commits intomasterfrom
refactor/storage-per-session
Open

Refactor/storage per session#15
dushanlk wants to merge 2 commits intomasterfrom
refactor/storage-per-session

Conversation

@dushanlk
Copy link
Member

  • Refactored the existing in-memory database to create databases per user session.

How to try

  1. For the initial request, trigger: http://localhost:8080/scrape?url=https://google.com
  2. Subsequent pagination URLs will be generated with the session ID. ie: http://localhost:8080/scrape/<session-id>/<request-id>/<page>
  3. To utilize the same session (same database) for subsequent new scraping requests, add the session_id query parameter to the URL. ie: http://localhost:8080/scrape?url=https://google.com&session_id=<session-id-from-prev-req>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant