allowed_domains for traversal #10
Description
Is your feature request related to a problem? Please describe.
in the traversal, there is no way for user to specifiy only specific white-listed domain only.
Describe the solution you'd like
Currently all the allowed_domains from the settings is used for this. But allowed_domains should be made specific to traversal. So that traversal link extraction will be taken care for only desired domains,
Describe alternatives you've considered
NA
Additional context
NA