Skip to content

Commit

Permalink
Move threshold up for flaky test with Electra (huggingface#6622)
Browse files Browse the repository at this point in the history
* Move threshold up for flaky test with Electra

* Update above as well
  • Loading branch information
sgugger authored and fabiocapsouza committed Nov 15, 2020
1 parent bbd2774 commit f16ebea
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions tests/test_modeling_tf_common.py
Original file line number Diff line number Diff line change
Expand Up @@ -306,13 +306,13 @@ def test_pt_tf_model_equivalence(self):

max_diff = np.amax(np.abs(tf_hidden_states - pt_hidden_states))
# Debug info (remove when fixed)
if max_diff >= 2e-2:
if max_diff >= 4e-2:
print("===")
print(model_class)
print(config)
print(inputs_dict)
print(pt_inputs_dict)
self.assertLessEqual(max_diff, 2e-2)
self.assertLessEqual(max_diff, 4e-2)

# Check we can load pt model in tf and vice-versa with checkpoint => model functions
with tempfile.TemporaryDirectory() as tmpdirname:
Expand Down

0 comments on commit f16ebea

Please sign in to comment.