Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot Download #240

Closed
nbwuzhe opened this issue Mar 29, 2016 · 12 comments
Closed

Cannot Download #240

nbwuzhe opened this issue Mar 29, 2016 · 12 comments
Labels

Comments

@nbwuzhe
Copy link

nbwuzhe commented Mar 29, 2016

无法下载,重试5次之后依然无法下载。但是除上传/下载以外其他功能正常,包括列出文件、比较文件等。
debug信息如下 (具体的TOKEN和URL略去。。。):

Loading Hash Cache File '/home/medrecon/.bypy/bypy.hashcache.json'...

Hash Cache File loaded.

Verbose level = 1
Debug level = 1
Config directory: '/home/medrecon/.bypy'
Token file: '/home/medrecon/.bypy/bypy.json'
Hash Cache file: '/home/medrecon/.bypy/bypy.hashcache.json'
App root path at Baidu Yun '/apps/bypy'
sys.stdin.encoding = UTF-8
sys.stdout.encoding = UTF-8

sys.stderr.encoding = UTF-8

HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[20:50:00] Waiting 10 seconds before retrying...
[20:50:10] Request Try #2 / 5
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: xxx
Params: xxx
Full URL: xxx
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[20:50:36] Waiting 20 seconds before retrying...
[20:50:56] Request Try #3 / 5
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[20:51:22] Waiting 30 seconds before retrying...
[20:51:52] Request Try #4 / 5
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[20:52:18] Waiting 40 seconds before retrying...
[20:52:58] Request Try #5 / 5
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[20:53:24] Maximum number (5) of tries failed.
Skip saving Hash Cache since it has not been updated.

@houtianze
Copy link
Owner

感谢反馈。

能贴出你用的命令吗?还有可以帮忙贴出加上-dv参数后的输出吗?

@nbwuzhe
Copy link
Author

nbwuzhe commented Mar 29, 2016

谢谢作者回复。-dv后的信息请见最后。

我试了download, downfile, downdir, syncdown,都不具体显示错误原因,只有5次重试。
另外我试了一下,下载1KB的小文件没有问题,但是30MB的文件就不行了,几个G的文件更不用提了。。。我也尝试把CHUNK降到1MB,还是没有用。

麻烦您看一下了,再次感谢。

Loading Hash Cache File '/home/medrecon/.bypy/bypy.hashcache.json'...

Hash Cache File loaded.

Verbose level = 1
Debug level = 1
Config directory: '/home/medrecon/.bypy'
Token file: '/home/medrecon/.bypy/bypy.json'
Hash Cache file: '/home/medrecon/.bypy/bypy.hashcache.json'
App root path at Baidu Yun '/apps/bypy'
sys.stdin.encoding = UTF-8
sys.stdout.encoding = UTF-8

sys.stderr.encoding = UTF-8

Token loaded:
{u'access_token':
u'21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671',
u'expires_in': 2592000, u'session_secret':
u'6b579e9f4aad1710875a74e3e177372e', u'scope': u'basic netdisk',
u'session_key':
u'9mnRJvJ8FLu6J8N6VC7txyscQStk8hMfL+bqST9Ws66+/NaQQapIFE9e4zVZdSdSpRkXKnwA+cufOdZr+3LKwccitNZK4m61',
u'refresh_token':
u'22.39d7622d040db25e2920be518ba2fbbb.315360000.1774619372.438898731-1572671'}
__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2062757070867395158}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Downloading '/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat' as
'/data/rawdata/fromBDY/meas_MID04224_FID171045_AdjCoilSens.dat'
Getting info of remote file
'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat' for later
verification
__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2062757119795577493}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Checking if we already have the copy locally
headers['Range'][6:]: 0-1048575 MC0xMDQ4NTc1
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', 0,
33139712, 1459261955.989977)
Params: {u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method':
u'download'}
Full URL:
https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=b7144d615ac47bdc76d299b715dc409dfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459261969&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-Hfic%2B5gG4OwDAfSX85BRLiY1gWI%3D&to=nj2hb&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=508196667&mlogid=2062757244777639987&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2062757244777639987&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[22:33:01] Waiting 10 seconds before retrying...
[22:33:11] Request Try #2 / 5

On Tue, Mar 29, 2016 at 10:20 PM, Hou Tianze notifications@github.com
wrote:

感谢反馈。

能贴出你用的命令吗?还有可以帮忙贴出加上-dv参数后的输出吗?


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@nbwuzhe
Copy link
Author

nbwuzhe commented Mar 29, 2016

刚才又测试了一下,发现把下载的CHUNK降到10KB以下就可以下载了,可是这个10KB的下载的速度真是。。。而且还是会断线,并再也连不上了。。。

求问这个问题怎么解决? 断线前后 -dv信息如下

[____________________] 0% (250.0kB/31.6MB) Request all goes fine
headers['Range'][6:]: 256000-266239 MjU2MDAwLTI2NjIzOQ==
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', 256000, 33139712, 1459262608.883183)
Params: {u'path': u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method': u'download'}
Full URL: https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=872167badb0750a4b75d57e622a7b8d2fdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459262659&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-HjLW1Blc1M5Yjhaw41XEy3%2FJWtM%3D&to=nj2hb&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=148469059&mlogid=2062942356793281326&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2062942356793281326&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[22:44:14] Waiting 10 seconds before retrying...
[22:44:24] Request Try #2 / 5
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', 256000, 33139712, 1459262608.883183)
Params: {u'path': u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method': u'download'}
Full URL: https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=872167badb0750a4915ef34dbce28152fdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459262677&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-tBUk0JG2ra8cjmhq%2BHecTWF%2BLy8%3D&to=nj2hb&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=431853844&mlogid=2062947356510910864&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2062947356510910864&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[22:44:36] Waiting 20 seconds before retrying...
[22:44:56] Request Try #3 / 5
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', 256000, 33139712, 1459262608.883183)
Params: {u'path': u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method': u'download'}
Full URL: https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=1b217f2b54bed5cb339ddb0e439fa286fdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459262710&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-D83fPk4jqwY7IewfqYpN%2F3JE2Ms%3D&to=nj2hb&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=931594944&mlogid=2062956083888541446&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2062956083888541446&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[22:45:08] Waiting 30 seconds before retrying...
[22:45:38] Request Try #4 / 5

谢谢作者回复。-dv后的信息请见最后。

我试了download, downfile, downdir, syncdown,都不具体显示错误原因,只有5次重试。
另外我试了一下,下载1KB的小文件没有问题,但是30MB的文件就不行了,几个G的文件更不用提了。。。我也尝试把CHUNK降到1MB,还是没有用。

麻烦您看一下了,再次感谢。

Loading Hash Cache File '/home/medrecon/.bypy/bypy.hashcache.json'...

Hash Cache File loaded.

Verbose level = 1
Debug level = 1
Config directory: '/home/medrecon/.bypy'
Token file: '/home/medrecon/.bypy/bypy.json'
Hash Cache file: '/home/medrecon/.bypy/bypy.hashcache.json'
App root path at Baidu Yun '/apps/bypy'
sys.stdin.encoding = UTF-8
sys.stdout.encoding = UTF-8

sys.stderr.encoding = UTF-8

Token loaded:
{u'access_token':
u'21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671',
u'expires_in': 2592000, u'session_secret':
u'6b579e9f4aad1710875a74e3e177372e', u'scope': u'basic netdisk',
u'session_key':
u'9mnRJvJ8FLu6J8N6VC7txyscQStk8hMfL+bqST9Ws66+/NaQQapIFE9e4zVZdSdSpRkXKnwA+cufOdZr+3LKwccitNZK4m61',
u'refresh_token':
u'22.39d7622d040db25e2920be518ba2fbbb.315360000.1774619372.438898731-1572671'}
__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2062757070867395158}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Downloading '/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat'
as '/data/rawdata/fromBDY/meas_MID04224_FID171045_AdjCoilSens.dat'
Getting info of remote file
'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat' for later
verification
__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2062757119795577493}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Checking if we already have the copy locally
headers['Range'][6:]: 0-1048575 MC0xMDQ4NTc1
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat',
0, 33139712, 1459261955.989977)
Params: {u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method':
u'download'}
Full URL:
https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=b7144d615ac47bdc76d299b715dc409dfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459261969&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-Hfic%2B5gG4OwDAfSX85BRLiY1gWI%3D&to=nj2hb&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=508196667&mlogid=2062757244777639987&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2062757244777639987&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[22:33:01] Waiting 10 seconds before retrying...
[22:33:11] Request Try #2 / 5

On Tue, Mar 29, 2016 at 10:20 PM, Hou Tianze notifications@github.com
wrote:

感谢反馈。

能贴出你用的命令吗?还有可以帮忙贴出加上-dv参数后的输出吗?


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@houtianze
Copy link
Owner

这个有点奇怪,没有任何错误就重试。你现在用的已经是最新版?可以帮忙加上-dddv试下吗?

@nbwuzhe
Copy link
Author

nbwuzhe commented Mar 30, 2016

是最新版,v1.2.17

刚试了 -dddv的结果如下,好像还是没有任何具体的错误信息。。。

Loading Hash Cache File '/home/medrecon/.bypy/bypy.hashcache.json'...

Hash Cache File loaded.

Verbose level = 1
Debug level = 3
Config directory: '/home/medrecon/.bypy'
Token file: '/home/medrecon/.bypy/bypy.json'
Hash Cache file: '/home/medrecon/.bypy/bypy.hashcache.json'
App root path at Baidu Yun '/apps/bypy'
sys.stdin.encoding = UTF-8
sys.stdout.encoding = UTF-8

sys.stderr.encoding = UTF-8

Token loaded:
{u'access_token':
u'21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671',
u'expires_in': 259200

                                                              0,

u'session_secret': u'6b579e9f4aad1710875a74e3e177372e', u'scope': u'basic
netdisk', u'session_key': u'9mnRJvJ8FLu6J8N

6VC7txyscQStk8hMfL+bqST9Ws66+/NaQQapIFE9e4zVZdSdSpRkXKnwA+cufOdZr+3LKwccitNZK4m61',
u'refresh_token': u'22.39d7622d040db

  25e2920be518ba2fbbb.315360000.1774619372.438898731-1572671'}

__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path

=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list HTTP/1.1\r\nHost:
pcs.baidu.com\r\nConnection: keep-alive\r\nAccept-

                Encoding: gzip, deflate\r\nAccept: */*\r\nUser-Agent:

netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\n\

                                r\n'

reply: 'HTTP/1.1 200 OK\r\n'
header: Date: Wed, 30 Mar 2016 05:41:56 GMT
header: Content-Type: text/html;charset=utf8
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTgwLjE2OC41OC4xOTA=
header: x-bs-request-id:
MTAuMjE1Ljg4LjEyOjg2NDI6MjA3NzM5OTU3ODYwOTY2NjE4MToyMDE2LTAzLTMwIDEzOjQxOjU2
header: pcs-cache-flag: 1
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.

2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1" 200 None
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.146185137

2.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path': u

              '/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat',

u'md5': u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712

                            }, {u'isdir': 0, u'ctime': 1459261410,

u'fs_id': 925233447408042, u'mtime': 1459261421, u'path':
u'/apps/bypy/new/setup.

                                                                py',

u'md5': u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}],
u'request_id': 2077399578609666181}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path': u'/apps

                    /bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat',

u'md5': u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Downloading '/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat' as
'/data/rawdata/fromBDY/meas_MID04224_FID1710

          45_AdjCoilSens.dat'

Getting info of remote file
'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat' for later
verification
__get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID04224_FID171045_AdjCoilSens.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs: /apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path

=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list HTTP/1.1\r\nHost:
pcs.baidu.com\r\nConnection: keep-alive\r\nAccept-

                Encoding: gzip, deflate\r\nAccept: */*\r\nUser-Agent:

netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\n\

                                r\n'

reply: 'HTTP/1.1 200 OK\r\n'
header: Date: Wed, 30 Mar 2016 05:41:56 GMT
header: Content-Type: text/html;charset=utf8
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTgwLjE2OC41OC4xOTA=
header: x-bs-request-id:
MTAuMjE1LjgwLjQzOjg2NDI6MjA3NzM5OTYyNjA3MTI2MDU5NzoyMDE2LTAzLTMwIDEzOjQxOjU2
header: pcs-cache-flag: 1
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.

2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1" 200 None
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.146185137

2.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path': u

              '/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat',

u'md5': u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712

                            }, {u'isdir': 0, u'ctime': 1459261410,

u'fs_id': 925233447408042, u'mtime': 1459261421, u'path':
u'/apps/bypy/new/setup.

                                                                py',

u'md5': u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}],
u'request_id': 2077399626071260597}
File info json: {u'isdir': 0, u'ctime': 1455628552, u'fs_id':
18071544306835, u'mtime': 1459260714, u'path': u'/apps

                    /bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat',

u'md5': u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}
Request all goes fine
Checking if we already have the copy locally
headers['Range'][6:]: 0-20971519 MC0yMDk3MTUxOQ==
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs: (u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', 0,
33139712, 1459316503.134892)
Params: {u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'method':
u'download'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): d.pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.2592000.1461851372.438898731-1572671&path

=%2Fapps%2Fbypy%2Fnew%2Fmeas_MID04224_FID171045_AdjCoilSens.dat&method=download
HTTP/1.1\r\nHost: d.pcs.baidu.com\r\nRan

      ge: bytes=0-20971519\r\nUser-Agent:

netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\nConnection:
keep-al

                                                ive\r\nAccept:

/\r\nAccept-Encoding: gzip, deflate\r\n\r\n'
reply: 'HTTP/1.1 302 Moved Temporarily\r\n'
header: Date: Wed, 30 Mar 2016 05:41:57 GMT
header: Content-Type: text/html
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTE2LjIzMS43OC4yOQ==
header: x-bs-request-id:
MTAuOTIuMTcuNDQ6ODY0MzoyMDc3Mzk5NzExNzI1Mzk0NTY2OjIwMTYtMDMtMzAgMTM6NDE6NTY=
header: x-pcs-member: 0
header: location:
https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6

a7511&xcode=06de5f7e65c6cecb4d290e68ce73f4fbfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1

459316517&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-CeKv%2B4eE1i102KDCZnm%2FRaY7VzI%3D&to=n2b&fm=Nan,B,T,t&sta_d

x=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25e

b1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=467124621&mlogid=2077399711725394566&vuk=-&vbdid=-&fin=meas_MID04224_FID17104

5_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2077399711725394566&dp-callid=0.1.1
header: x-poms-key: 0000c0ceb3e29ece3b679e25eb1e8e6a7511
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.bcd75210167244a804ee20e9bdee7ced.

2592000.1461851372.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew%2Fmeas_MID04224_FID171045_AdjCoilSens.dat&method=download

                                         HTTP/1.1" 302 None

INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): pcscdns.baidu.com
send: 'GET
/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a7511&xcode=06de5f7e65c6cecb4d29

0e68ce73f4fbfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=1459316517&sign=FDTAXGERLBH-DCb74

0ccc5511e5e8fedcff06b081203-CeKv%2B4eE1i102KDCZnm%2FRaY7VzI%3D&to=n2b&fm=Nan,B,T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=

7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8e6a7511&sl=81068110&expires=

8h&rt=pr&r=467124621&mlogid=2077399711725394566&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_AdjCoilSens.dat&slt=pm&uta=3&r

type=1&iv=0&isw=0&dp-logid=2077399711725394566&dp-callid=0.1.1
HTTP/1.1\r\nHost: pcscdns.baidu.com\r\nRange: bytes=0-209

                      71519\r\nAccept-Encoding: gzip,

deflate\r\nConnection: keep-alive\r\nAccept: /\r\nUser-Agent:
netdisk;5.2.7.2;PC;PC-Wi

ndows;6.2.9200;WindowsBaiduYunGuanJia\r\n\r\n'
reply: 'HTTP/1.1 206 Partial Content\r\n'
header: Server: bfe/1.0.8.13
header: Date: Wed, 30 Mar 2016 05:41:57 GMT
header: Content-Type: application/octet-stream
header: Content-Length: 20971520
header: Connection: keep-alive
header: ETag: c404cfa22570ad82c7e0e539e6c83d70
header: Last-Modified: Mon, 15 Feb 2016 15:14:52 GMT
header: Expires: Sat, 02 Apr 2016 05:41:57 GMT
header: Cache-Control: max-age=259200
header: Content-Range: bytes 0-20971519/33139712
header: Accept-Ranges: bytes
header: x-bs-file-size: 33139712
header: x-bs-meta-crc32: 4248891787
header: x-bs-client-ip: MTE1LjIzMS40Mi4xOTA=
header: x-bs-request-id:
MTAuMTkyLjI5LjE3Ojg2NjA6MjA3NzM5OTcxMTcyNTM5NDU2NjoyMDE2LTAzLTMwIDEzOjQxOjU3
header: Content-Disposition:
attachment;filename="meas_MID04224_FID171045_AdjCoilSens.dat"
header: Content-MD5: c404cfa22570ad82c7e0e539e6c83d70
header: superfile: 2
header: Access-Control-Allow-Origin: *
header: Access-Control-Allow-Methods: GET, PUT, POST, DELETE, OPTIONS, HEAD
DEBUG:requests.packages.urllib3.connectionpool:"GET
/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e

25eb1e8e6a7511&xcode=06de5f7e65c6cecb4d290e68ce73f4fbfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-180715443068

35&time=1459316517&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-CeKv%2B4eE1i102KDCZnm%2FRaY7VzI%3D&to=n2b&fm=Nan,B,

T,t&sta_dx=32&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece

3b679e25eb1e8e6a7511&sl=81068110&expires=8h&rt=pr&r=467124621&mlogid=2077399711725394566&vuk=-&vbdid=-&fin=meas_MID04224

_FID171045_AdjCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2077399711725394566&dp-callid=0.1.1
HTTP/1.1" 206 20

                                                          971520

Full URL:
https://pcscdns.baidu.com/file/c404cfa22570ad82c7e0e539e6c83d70?bkt=p3-0000c0ceb3e29ece3b679e25eb1e8e6a751

1&xcode=06de5f7e65c6cecb4d290e68ce73f4fbfdd5d27d42b8a41d0b2977702d3e6764&fid=438898731-1572671-18071544306835&time=14593

16517&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-CeKv%2B4eE1i102KDCZnm%2FRaY7VzI%3D&to=n2b&fm=Nan,B,T,t&sta_dx=32

&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,t&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000c0ceb3e29ece3b679e25eb1e8

e6a7511&sl=81068110&expires=8h&rt=pr&r=467124621&mlogid=2077399711725394566&vuk=-&vbdid=-&fin=meas_MID04224_FID171045_Ad

jCoilSens.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2077399711725394566&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[13:42:08] Waiting 10 seconds before retrying...
[13:42:18] Request Try #2 / 5

On Wed, Mar 30, 2016 at 1:10 PM, Hou Tianze notifications@github.com
wrote:

这个有点奇怪,没有任何错误就重试。你现在用的已经是最新版?可以帮忙加上-dddv试下吗?


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@houtianze
Copy link
Owner

这个太诡异了。。暂时无头绪,我刚试了一下,我这里下载是可以的。
就像重启是解决系统问题的最后大招,你试试以下是否有用:

  • bypy -c后重新授权
  • 升级requests, pyopensslsudo apt-get install -u requests; sudo apt-get install -u pyopenssl

@nbwuzhe
Copy link
Author

nbwuzhe commented Apr 2, 2016

谢谢回复。升级了pyopenssl后(升级命令似乎应该是sudo pip install --upgrade pyopenssl
?)似乎可以下载一些小文件了(几十MB),没有报错信息,但速度很慢,只有10KB左右,和用的光纤速度完全不匹配。。。

另外,下载大文件(>2GB)时会报错,看内容似乎是downchunk有问题?我一开始用的命令没有额外设置chunk大小,就用的是默认值(如果没记错的话默认值是3MB)。报错信息如下:

[10:27:51] Error accessing 'https://d.pcs.baidu.com/rest/2.0/pcs/file'
[10:27:51] Exception:
<class 'requests.exceptions.ConnectionError'> - HTTPConnectionPool(host='
qd2.cache.baidupcs.com', port=80): Read timed out.
Stack:
File "./bypy.py", line 4368, in
main()
File "./bypy.py", line 4347, in main
result = getattr(by, args.command[0])(_uargs)
File "./bypy.py", line 3034, in download
return self.downfile(remotepath, localpath)
File "./bypy.py", line 2875, in downfile
return self.__downfile(pcsrpath, localfile)
File "./bypy.py", line 2847, in __downfile
return self.__downchunks(rfile, offset)
File "./bypy.py", line 2766, in __downchunks
self.__downchunks_act, (rfile, offset, rsize, start_time), headers =
headers, cookies = self.__cookies)
File "./bypy.py", line 1823, in __get
return self.__request(url, pars, act, 'GET', actargs, retry, addtoken,
dumpex, *_kwargs)
File "./bypy.py", line 1801, in __request
result = self.__request_work(url, pars, act, method, actargs, addtoken,
dumpex, **kwnew)
File "./bypy.py", line 1755, in __request_work
self.__dump_exception(ex, url, pars, r, act)
File "./bypy.py", line 1574, in __dump_exception
perr(formatex(ex))
File "./bypy.py", line 476, in formatex
type(ex), ex, ''.join(traceback.format_stack()))

[10:27:51] Function: __downchunks_act
[10:27:51] Website parameters: {u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'method': u'download'}
[10:27:51] Waiting 10 seconds before retrying...
[10:28:02] Request Try #2 / 5

而后我又尝试把CHUNK改为1MB,则能开始下载大文件,但速度还是很慢(目测大约也就10KB/s左右)。不知道是不是还是可能有哪里设置得不对的地方?下载>2GB文件的
-dddv 信息如下(只放了第一个chunk的信息;大约每两三分钟才能下完一个1MB的CHUNK,同时有一些debug信息的更新):

Loading Hash Cache File '/home/medrecon/.bypy/bypy.hashcache.json'...

Hash Cache File loaded.

Verbose level = 1
Debug level = 3
Config directory: '/home/medrecon/.bypy'
Token file: '/home/medrecon/.bypy/bypy.json'
Hash Cache file: '/home/medrecon/.bypy/bypy.hashcache.json'
App root path at Baidu Yun '/apps/bypy'
sys.stdin.encoding = UTF-8
sys.stdout.encoding = UTF-8

sys.stderr.encoding = UTF-8

Token loaded:
{u'access_token':
u'21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671',
u'expires_in': 2592000, u'session_secret':
u'0843d78f63301d83ab6be4fbc53029d4', u'scope': u'basic netdisk',
u'session_key':
u'9mnRd3UTG6zMNf/PVyw02K86eoVfToVXgDl352vtPIXDC4/rAtmXCe+8QfiYjPCNbUItROKghzHufptlNkAgyLVN5r+RQyTV',
u'refresh_token':
u'22.9586ab3017d0c9ead83d39eebca16a44.315360000.1774850499.438898731-1572671'}
**get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs:
/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1\r\nHost: pcs.baidu.com\r\nConnection:
keep-alive\r\nAccept-Encoding: gzip, deflate\r\nAccept: /\r\nUser-Agent:
netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Date: Sat, 02 Apr 2016 02:39:41 GMT
header: Content-Type: text/html;charset=utf8
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTgwLjE2OC41OC4xOTA=
header: x-bs-request-id:
MTAuMjE1LjExMy41Mzo4NjQyOjIxNDQwNDI3MjU4NTM1OTk5MzI6MjAxNi0wNC0wMiAxMDozOTo0MQ==
header: pcs-cache-flag: 1
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1" 200 None
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455634697, u'fs_id':
90811746455792, u'mtime': 1459563934, u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'md5': u'9442742e356a34ba0f6c2f2e716c1656', u'size': 6572518400},
{u'isdir': 0, u'ctime': 1455628552, u'fs_id': 18071544306835, u'mtime':
1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2144042725853599932}
File info json: {u'isdir': 0, u'ctime': 1455634697, u'fs_id':
90811746455792, u'mtime': 1459563934, u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'md5': u'9442742e356a34ba0f6c2f2e716c1656', u'size': 6572518400}
Request all goes fine
Downloading
'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat'
as
'/data/rawdata/fromBDY/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat'
Getting info of remote file
'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat'
for later verification
**get_file_info(): rdir : /apps/bypy/new | rfile:
meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat
GET https://pcs.baidu.com/rest/2.0/pcs/file
actargs:
/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat
Params: {u'path': u'/apps/bypy/new', u'order': u'asc', u'method':
u'list', u'by': u'name'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1\r\nHost: pcs.baidu.com\r\nConnection:
keep-alive\r\nAccept-Encoding: gzip, deflate\r\nAccept: /\r\nUser-Agent:
netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Date: Sat, 02 Apr 2016 02:39:41 GMT
header: Content-Type: text/html;charset=utf8
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTE2LjIzMS43OC4yOQ==
header: x-bs-request-id:
MTAuMjE0LjM5LjYzOjg2NDI6MjE0NDA0Mjc4ODk1MDA0MjUxMToyMDE2LTA0LTAyIDEwOjM5OjQx
header: pcs-cache-flag: 1
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP/1.1" 200 None
Full URL:
https://pcs.baidu.com/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew&by=name&order=asc&method=list
HTTP Status Code: 200
200 OK, processing action
List json: {u'list': [{u'isdir': 0, u'ctime': 1455634697, u'fs_id':
90811746455792, u'mtime': 1459563934, u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'md5': u'9442742e356a34ba0f6c2f2e716c1656', u'size': 6572518400},
{u'isdir': 0, u'ctime': 1455628552, u'fs_id': 18071544306835, u'mtime':
1459260714, u'path':
u'/apps/bypy/new/meas_MID04224_FID171045_AdjCoilSens.dat', u'md5':
u'c404cfa22570ad82c7e0e539e6c83d70', u'size': 33139712}, {u'isdir': 0,
u'ctime': 1459261410, u'fs_id': 925233447408042, u'mtime': 1459261421,
u'path': u'/apps/bypy/new/setup.py', u'md5':
u'cdc6da1b27079ac3f4b9900f0eb7a0bb', u'size': 1679}], u'request_id':
2144042788950042511}
File info json: {u'isdir': 0, u'ctime': 1455634697, u'fs_id':
90811746455792, u'mtime': 1459563934, u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'md5': u'9442742e356a34ba0f6c2f2e716c1656', u'size': 6572518400}
Request all goes fine
Checking if we already have the copy locally
headers['Range'][6:]: 0-1048575 MC0xMDQ4NTc1
GET https://d.pcs.baidu.com/rest/2.0/pcs/file
actargs:
(u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
0, 6572518400, 1459564781.140683)
Params: {u'path':
u'/apps/bypy/new/meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat',
u'method': u'download'}
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): d.pcs.baidu.com
send: 'GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew%2Fmeas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&method=download
HTTP/1.1\r\nHost: d.pcs.baidu.com\r\nRange: bytes=0-1048575\r\nUser-Agent:
netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\nConnection:
keep-alive\r\nAccept: /\r\nAccept-Encoding: gzip, deflate\r\n\r\n'
reply: 'HTTP/1.1 302 Moved Temporarily\r\n'
header: Date: Sat, 02 Apr 2016 02:39:42 GMT
header: Content-Type: text/html
header: Transfer-Encoding: chunked
header: Connection: keep-alive
header: x-bs-client-ip: MTgwLjE2OC41OC4xOTA=
header: x-bs-request-id:
MTAuOTIuMTkuNjE6ODY0MjoyMTQ0MDQyOTQxMTQ2MTg0NjQyOjIwMTYtMDQtMDIgMTA6Mzk6NDI=
header: x-pcs-member: 0
header: location:
http://qd2.cache.baidupcs.com/file/9442742e356a34ba0f6c2f2e716c1656?bkt=p3-0000e38054d7128778934a1157aa3bd6ca29&xcode=dd7aca13916719c7726f0c4d18727629764551e7448a10c20b2977702d3e6764&fid=438898731-1572671-90811746455792&time=1459564782&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-94DksgQuVxeY7fpqvG3HiqSA%2BeQ%3D&to=qc2&fm=Nan,B,T,ny&sta_dx=6268&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,ny&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000e38054d7128778934a1157aa3bd6ca29&sl=81068110&expires=8h&rt=pr&r=251430550&mlogid=2144042941146184642&vuk=-&vbdid=-&fin=meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2144042941146184642&dp-callid=0.1.1
header: x-poms-key: 0000e38054d7128778934a1157aa3bd6ca29
header: Server: POMS/CloudUI 1.0
DEBUG:requests.packages.urllib3.connectionpool:"GET
/rest/2.0/pcs/file?access_token=21.3e2d0970a23e5b9b8998e7de967a8d9b.2592000.1462082499.438898731-1572671&path=%2Fapps%2Fbypy%2Fnew%2Fmeas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&method=download
HTTP/1.1" 302 None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection
(1): qd2.cache.baidupcs.com
send: 'GET
/file/9442742e356a34ba0f6c2f2e716c1656?bkt=p3-0000e38054d7128778934a1157aa3bd6ca29&xcode=dd7aca13916719c7726f0c4d18727629764551e7448a10c20b2977702d3e6764&fid=438898731-1572671-90811746455792&time=1459564782&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-94DksgQuVxeY7fpqvG3HiqSA%2BeQ%3D&to=qc2&fm=Nan,B,T,ny&sta_dx=6268&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,ny&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000e38054d7128778934a1157aa3bd6ca29&sl=81068110&expires=8h&rt=pr&r=251430550&mlogid=2144042941146184642&vuk=-&vbdid=-&fin=meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2144042941146184642&dp-callid=0.1.1
HTTP/1.1\r\nHost: qd2.cache.baidupcs.com\r\nConnection:
keep-alive\r\nRange: bytes=0-1048575\r\nAccept-Encoding: gzip,
deflate\r\nAccept: /\r\nUser-Agent:
netdisk;5.2.7.2;PC;PC-Windows;6.2.9200;WindowsBaiduYunGuanJia\r\n\r\n'
reply: 'HTTP/1.1 206 Partial Content\r\n'
header: Server: JSP3/2.0.14
header: Date: Sat, 02 Apr 2016 02:39:42 GMT
header: Content-Type: application/octet-stream
header: Content-Length: 1048576
header: Connection: close
header: ETag: 164e1811680ea8ec207e26b278bdd33f
header: Last-Modified: Tue, 16 Feb 2016 14:58:13 GMT
header: Expires: Tue, 05 Apr 2016 02:26:25 GMT
header: Age: 797
header: Cache-Control: max-age=259200
header: Content-Range: bytes 0-1048575/6572518400
header: Accept-Ranges: bytes
header: x-bs-file-size: 6572518400
header: x-bs-meta-crc32: 2113729535
header: x-bs-client-ip: MTYzLjE3Ny44LjEwNw==
header: x-bs-request-id:
MTAuMjA1LjcwLjQ3Ojg2NjA6MjE0MzgyNDI4NzM0MjQ0MjgwMjoyMDE2LTA0LTAyIDEwOjI2OjIy
header: Content-Disposition:
attachment;filename="meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat"
header: Content-MD5: 164e1811680ea8ec207e26b278bdd33f
header: superfile: 2
header: Access-Control-Allow-Origin: *
header: Access-Control-Allow-Methods: GET, PUT, POST, DELETE, OPTIONS, HEAD
DEBUG:requests.packages.urllib3.connectionpool:"GET
/file/9442742e356a34ba0f6c2f2e716c1656?bkt=p3-0000e38054d7128778934a1157aa3bd6ca29&xcode=dd7aca13916719c7726f0c4d18727629764551e7448a10c20b2977702d3e6764&fid=438898731-1572671-90811746455792&time=1459564782&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-94DksgQuVxeY7fpqvG3HiqSA%2BeQ%3D&to=qc2&fm=Nan,B,T,ny&sta_dx=6268&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,ny&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000e38054d7128778934a1157aa3bd6ca29&sl=81068110&expires=8h&rt=pr&r=251430550&mlogid=2144042941146184642&vuk=-&vbdid=-&fin=meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2144042941146184642&dp-callid=0.1.1
HTTP/1.1" 206 1048576
Full URL:
http://qd2.cache.baidupcs.com/file/9442742e356a34ba0f6c2f2e716c1656?bkt=p3-0000e38054d7128778934a1157aa3bd6ca29&xcode=dd7aca13916719c7726f0c4d18727629764551e7448a10c20b2977702d3e6764&fid=438898731-1572671-90811746455792&time=1459564782&sign=FDTAXGERLBH-DCb740ccc5511e5e8fedcff06b081203-94DksgQuVxeY7fpqvG3HiqSA%2BeQ%3D&to=qc2&fm=Nan,B,T,ny&sta_dx=6268&sta_cs=1&sta_ft=dat&sta_ct=7&fm2=Nanjing02,B,T,ny&newver=1&newfm=1&secfm=1&flow_ver=3&pkey=0000e38054d7128778934a1157aa3bd6ca29&sl=81068110&expires=8h&rt=pr&r=251430550&mlogid=2144042941146184642&vuk=-&vbdid=-&fin=meas_MID02653_FID216251_radial_vibe_golden_tres3_4s_dyn.dat&slt=pm&uta=3&rtype=1&iv=0&isw=0&dp-logid=2144042941146184642&dp-callid=0.1.1
HTTP Status Code: 206
206 Partial Content (this is OK), processing action
[________________****] 0% (1.0MB/6.1GB) Request all goes fine

2016-04-01 11:45 GMT+08:00 Hou Tianze notifications@github.com:

这个太诡异了。。暂时无头绪,我刚试了一下,我这里下载是可以的。
就像重启是解决系统问题的最后大招,你试试以下是否有用:

  • bypy -c后重新授权
  • 升级requests, pyopenssl (sudo apt-get install -u requests; sudo
    apt-get install -u pyopenssl)


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@houtianze
Copy link
Owner

看错误是ConnectionError,应该是网络问题,程序会重试的。不过速度问题就没啥办法了。

@nbwuzhe
Copy link
Author

nbwuzhe commented Apr 2, 2016

是百度对速度做了限制吗?我这边网络接入速度很快的。百度会员账户有没有可能会快点?

On Sat, Apr 2, 2016 at 11:23 AM, Hou Tianze notifications@github.com
wrote:

看错误是ConnectionError,应该是网络问题,程序会重试的。不过速度问题就没啥办法了。


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@houtianze
Copy link
Owner

我怀疑要么百度那边做了点限制,要么百度的cdn在不同区域速度有些问题,不过都没法确认。

@nbwuzhe
Copy link
Author

nbwuzhe commented Apr 2, 2016

好,我再看看有没有别的办法去筛查这个问题的原因。非常感谢作者君拿出这么好的东西分享给我们。

On Sat, Apr 2, 2016 at 3:01 PM, Hou Tianze notifications@github.com wrote:

我怀疑要么百度那边做了点限制,要么百度的cdn在不同区域速度有些问题,不过都没法确认。


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#240 (comment)

@houtianze
Copy link
Owner

好,有时候我的下载速度也是非常慢,至今也没办法找出确切原因或有效方案。
不客气,这个东西大家觉得有点用就值了 😃

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants