Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

在抓取过程中突然卡住三四个小时,ctrl C不会退出。应该是mq处理出现问题了 #53

Closed
tottilin opened this issue Dec 10, 2015 · 1 comment
Assignees

Comments

@tottilin
Copy link

Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 810, in *bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 763, in run
self.__target(_self.__args, _self.__kwargs)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/__init
.py", line 103, in _init_process
self.put(objs, flush=flush)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/node.py", line 407, in put
self._remote_or_local_batch_put(addr, self.caches[addr])
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/node.py", line 348, in _remote_or_local_batch_put
self.mq_node.batch_put(objs)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/node.py", line 151, in batch_put
self.put(obs, force=force, priority=priority)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/node.py", line 125, in put
priority_store.put(objs, force=force)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/store.py", line 291, in put
result = self.put_one(obj, force, commit=False)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/store.py", line 266, in put_one
pos = self._seek_writable_pos(m)
File "/mnt/hgfs/crawl/cola-code/cola/core/mq/store.py", line 228, in _seek_writable_pos
size, = struct.unpack('I', map_handle[pos:pos+4])
TypeError: 'NoneType' object has no attribute 'getitem'

Catch interrupt signal, start to stop

@qinxuye qinxuye self-assigned this Dec 10, 2015
@qinxuye qinxuye added duplicate and removed question labels Aug 9, 2016
@qinxuye
Copy link
Owner

qinxuye commented Aug 9, 2016

refer to handle of #59

@qinxuye qinxuye closed this as completed Aug 9, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants