Skip to content

Commit

Permalink
I am paranoid.
Browse files Browse the repository at this point in the history
  • Loading branch information
ntai-arxiv committed Sep 9, 2024
1 parent 8b2529d commit 35fb467
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion script/sync_prod_to_gcp/submissions_to_gcp.py
Original file line number Diff line number Diff line change
Expand Up @@ -877,7 +877,7 @@ def move_bucket_objects(gs_client, objects: typing.List[(str, str, str)], log_ex
continue
to_blob: Blob = bucket.blob(to_obj)
if to_blob.exists():
if to_blob.md5_hash == from_blob.md5_hash:
if to_blob.md5_hash == from_blob.md5_hash and to_blob.size == from_blob.size:
# The object is already in the orig, and should not be in /ftp
from_blob.delete()
logger.warning("%s: %s <---> %s are identical - moved md5[%s]", obj_type, from_obj, to_obj, from_blob.md5_hash, extra=log_extra)
Expand Down

0 comments on commit 35fb467

Please sign in to comment.