Skip to content

suraj-arya/scrapy-lambda

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapy-lambda


Scrapy pipeline which invokes a lambda with the scraped item

Install

   pip install ScrapyElasticSearch

Usage (Configure settings.py:)

   ITEM_PIPELINES = {
       'scrapylambda.AWSLambdaPipeline': 800
   }

About

A scrapy extension to invoke an aws lambda function with the scraped item

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages