Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paraphraser hangs when invoked repeatedly in a loop #20

Open
lenyabloko opened this issue Feb 29, 2020 · 3 comments
Open

Paraphraser hangs when invoked repeatedly in a loop #20

lenyabloko opened this issue Feb 29, 2020 · 3 comments

Comments

@lenyabloko
Copy link

I am getting this info from console, not sure where it comes from and how to make the change:

The notebook server will temporarily stop sending output
to the client in order to avoid crashing it.
To change this limit, set the config variable
`--NotebookApp.iopub_data_rate_limit`.

Current values:
NotebookApp.iopub_data_rate_limit=1000000.0 (bytes/sec)
NotebookApp.rate_limit_window=3.0 (secs)

@lenyabloko
Copy link
Author

lenyabloko commented Feb 29, 2020

Found out what it was: I tried to find why it hangs and put a print() statement in the source. Apparently, that was a sensitive spot (see https://stackoverflow.com/questions/50689784/in-google-collab-i-get-iopub-data-rate-exceeded).

So I removed the print() and dont get these messages. But it still hangs. I have a feeling it does not like particular sentence I feed it. Not sure what to do. It hangs after sentence 10:

INFO:tensorflow:Restoring parameters from /content/train-20180325-001253/model-171856
  0%|          | 0/13000 [00:00<?, ?it/s]Original: Goodfellow's theory has been questioned, however, because the plane made two other sharp turns that would've been impossible if the pilots were unconscious.
  0%|          | 1/13000 [00:02<8:22:00,  2.32s/it]Original: However, both campaigners and pro-People's Vote MPs say that this number would be grow significantly if there were no other viable means of avoiding leaving the EU without a Withdrawal Agreement.
  0%|          | 2/13000 [00:03<7:08:57,  1.98s/it]Original: Things could have been even better if the whole chip industry wasn't constrained by chip foundries such as Taiwan Semiconductor Manufacturing (NYSE: TSM) and United Microelectronics getting swamped under more orders than they can handle.
  0%|          | 3/13000 [00:04<6:17:13,  1.74s/it]Original: The new request, if approved, would keep the military forces on the border through Jan.
  0%|          | 4/13000 [00:05<5:36:43,  1.55s/it]Original: Companies in financial difficulty can currently only negotiate down wages and conditions to below those established by the collective bargaining procedure if they have the approval of unions, which is rarely given.
  0%|          | 5/13000 [00:06<5:12:36,  1.44s/it]Original: If needed, I would like to have the right to try.
  0%|          | 6/13000 [00:08<4:49:29,  1.34s/it]Original: In a REIT situation, the operating companies would have to fund operations without the backing of real estate, and if revenue declines, they could see profits and debt funding dry up.
  0%|          | 7/13000 [00:09<4:39:23,  1.29s/it]Original: If Mr McCain is in charge, his record of bipartisan outreach will stand him in good stead; Mr Obama will be able to rely on solid majorities in Congress.
  0%|          | 8/13000 [00:10<4:31:51,  1.26s/it]Original: Regulatory measures may be considered if private sector efforts are not implemented.
  0%|          | 9/13000 [00:11<4:31:22,  1.25s/it]Original: A vote outside of the normal meeting time can come up if the SEC is racing to beat the statute of limitations on filing a charge, the source said.
  0%|          | 10/13000 [00:12<4:25:52,  1.23s/it]Original: Folks might not have felt like paying $10 a ticket to see films that have proven to be rather disappointing at the box office, like Cinderella Man or Kingdomof Heaven, but it stands to reason -- as has always been the case -- that many people will probably rent them, or even buy them, on DVD.

@lenyabloko
Copy link
Author

Yea, - it does not take ',' in a sentence! Not sure about other punctuation.

@Raldir
Copy link

Raldir commented Mar 9, 2020

I added a comment and solution in #1 (comment) to address this problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants