[ create a new paste ] login | about

Link: http://codepad.org/qvRjg925    [ raw code | fork ]

Python, pasted on Apr 12:
': 116,
 'downloader/response_bytes': 6139156,
 'downloader/response_count': 116,
 'downloader/response_status_count/200': 107,
 'downloader/response_status_count/301': 6,
 'downloader/response_status_count/302': 1,
 'downloader/response_status_count/404': 2,
 'dupefilter/filtered': 3221,
 'file_count': 79,
 'file_status_count/uptodate': 79,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2017, 1, 1, 5, 57, 22, 199957),
 'in_stock_items_count': 22,
 'invalid_items_count': 84,
 'item_scraped_count': 22,
 'iteration_duration': 0.06,
 'log_count/DEBUG': 1697,
 'log_count/INFO': 5132,
 'log_count/WARNING': 292,
 'manufacturer_empty_items_count': 0,
 'manufacturer_populated_items_count': 22,
 'model_populated_items_count': 0,
 'offsite/domains': 4,
 'offsite/filtered': 428,
 'out_stock_items_count': 0,
 'request_depth_max': 4,
 'response_received_count': 109,
 'scheduler/dequeued': 116,
 'scheduler/dequeued/disk': 116,
 'scheduler/enqueued': 116,
 'scheduler/enqueued/disk': 116,
 'scraped_few_items': False,
 'start_time': datetime.datetime(2017, 1, 1, 5, 53, 44, 65291),
 'yaoota/survived_crawled_products': 22,
 'zero_price_items_count': 0}


Create a new paste based on this one


Comments: