1 min readJul 1, 2018
Hi guys,there is a one problem in scrapycontrol while scrapycontrol script pass the url the spider does not receive url correctly due to symbol in the url,if the url have symbol link &,- etc.,for example if the scrapycontrol sending the url www.examplewebsites.com/page&=1/ to the spider and the spider receive the url link www.examplewebsites.com/page/ and second url like =1 so the arugment is split due to & symbol To fix this issue i used txt file to pass the url inbetween the scrapycontrol and spider.Here is updated link -https://github.com/vigneshgig/scrapingfaster/tree/master/scrapycontrol_new