mported /home/m/thesource2.to-2021-06-15-61158794/igsets Imported /home/m/thesource2.to-2021-06-15-61158794/ignores Connected to ws://127.0.0.1:29000 Imported /home/m/thesource2.to-2021-06-15-61158794/max_content_length 200 OK https://thesource2.to/ Imported /home/m/thesource2.to-2021-06-15-61158794/delay Imported /home/m/thesource2.to-2021-06-15-61158794/concurrency /home/m/gs-venv/lib/python3.7/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete. warnings.warn(_('HTTP session did not complete.')) ERROR Fatal exception. Traceback (most recent call last): File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/application/app.py", line 157, in run yield from pipeline.process() File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/pipeline/pipeline.py", line 194, in process yield from self._process_one_worker() File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/pipeline/pipeline.py", line 215, in _process_one_worker task.result() File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/pipeline/pipeline.py", line 119, in process item = yield from self.process_one(_worker_id=worker_id) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/pipeline/pipeline.py", line 103, in process_one yield from task.process(item) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/application/tasks/download.py", line 421, in process yield from session.app_session.factory['Processor'].process(session) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/delegate.py", line 29, in process return (yield from processor.process(item_session)) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/web.py", line 91, in process return (yield from session.process()) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/web.py", line 185, in process yield from self._process_loop() File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/web.py", line 244, in _process_loop exit_early, wait_time = yield from self._fetch_one(cast(Request, self._item_session.request)) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/web.py", line 308, in _fetch_one action = self._handle_response(request, response) File "/home/m/gs-venv/lib/python3.7/site-packages/wpull/processor/web.py", line 423, in _handle_response self._processing_rule.scrape_document(self._item_session) File "/home/m/gs-venv/lib/python3.7/site-packages/libgrabsite/wpull_tweaks.py", line 43, in scrape_document dupe_of = dupes_db.get_old_url(digest) File "/home/m/gs-venv/lib/python3.7/site-packages/libgrabsite/dupes.py", line 37, in get_old_url maybe_url = txn.get(digest) lmdb.CorruptedError: mdb_get: MDB_CORRUPTED: Located page was wrong type CRITICAL Sorry, Wpull unexpectedly crashed.