Scrapy - Run with python or shell
I was just wondering if anyone could tell me the potential issues or
advantages of running scrapy using the CLI or with python. I'm
predominantly using python at the moment but currently I'm using it to run
the "scrapy crawl" command, but considering using the twisted reactor code
to start it.
It seems like there are well documented ways of running via both methods
but I didn't know if either one was in any way preferable. For example,
does one way give more control, does one way manage memory useage better,
or anything else I should be aware of.
Any help or advice would be much appreciated.
No comments:
Post a Comment