Some questions

[pkiula]

Hello

Thank you for sharing this. Is this the same class as the one found on Sourceforge? Could we have examples of GETting and POSTing content with full simulation of a user's browser? In Curl world this requires a lot of work with SSL in particular, with verifypeer etc to be set, and the CookieJar stuff to be precise. Is this set internally in Snoopy world? Some more advanced examples would be very helpful as needed in the real world. The demo example code here is not very practical.

Thanks!

[pkiula]

To be clear, we'd like to issue a POST Request based on the following parameters.

    POST /owners/SearchResults HTTP/1.1
    Host: [DESTINATION HOST]
    Connection: keep-alive
    Content-Length: 228
    Cache-Control: max-age=0
    Origin: [DOMAIN NAME OF DESTINATION SITE]
    Upgrade-Insecure-Requests: 1
    DNT: 1
    Content-Type: application/x-www-form-urlencoded
    User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3
    Referer: https://[DESTINATION URL REFERER]
    Accept-Encoding: gzip, deflate, br
    Accept-Language: en-US,en;q=0.9,da;q=0.8,de;q=0.7,es;q=0.6,it;q=0.5,zh-CN;q=0.4,zh;q=0.3,hi;q=0.2,la;q=0.1,fr;q=0.1,cy;q=0.1
    Cookie: akamai_tls_version=tls1.2; JSESSIONID=8fiP_ido_FAqwFKVlTrpJMH_8KI0seEsQ0Jkz82PEq9gKUVhTtuc!829672636; qbjsessionid=HnhfAw6cTk0oB1PiGoSHICtHDRl59r0T_fQ9RO0ZtT06XWnjCRS_!735146385!NONE; ELB_TARGET=

Based on this, the page returns an HTML page, which has a container, which is filled with JS AJAX. So the HTML source per se does not have the content we need. Will Snoopy be able to determine the content that's updated in a container via AJAX, and then click on page number URLs within that content to extract all the content as a human user would have?