Code

Google Cloud Storage (GCS)#404

Code

Merged

mpenkov merged 87 commits intopiskvorky:masterpiskvorky/smart_open:masterfrom petedannemann:gcsCopy head branch name to clipboardJan 24, 2020

+1,550-5

Commits

Commits on Nov 11, 2019

• GCS support working

  

  Peter Dannemann

  committed
  6eeb5b4

Commits on Nov 12, 2019

• Start updating setup.py and README

  

  Peter Dannemann

  committed
  45e1019

• Add .idea/ to .gitignore

  

  Peter Dannemann

  committed
  ae6c252

• Move integration tests to their proper location

  

  Peter Dannemann

  committed
  38905ae

Commits on Nov 15, 2019

• All unit tests passing with mocks

  

  Peter Dannemann

  committed
  d054a87

• Add gcs integration tests

  

  Peter Dannemann

  committed
  a5e2a6e

Commits on Nov 19, 2019

• Add .env to .gitignore

  

  Peter Dannemann

  committed
  4fc43fa

Commits on Jan 5, 2020

• Integration tests passing

  

  Peter Dannemann

  committed
  67feb7b

• Remove kms integration test

  

  Peter Dannemann

  committed
  62252f0

• Fix failing test

  

  Peter Dannemann

  committed
  40cbb7d

• Change writer from buffer size to min part size

  

  Peter Dannemann

  committed
  5769e9b

• Merge branch 'master' into gcs

  petedannemann

  authored
  056abe9

• Fix typo

  petedannemann

  committed
  c31f79d

• Change buffer size to min part size

  petedannemann

  committed
  e2be283

• Fix another missed min_part_size

  petedannemann

  committed
  0eca1d3

• Fix broken example

  petedannemann

  committed
  9357d48

• Change smart_open to open

  petedannemann

  committed
  eb2817b

• Make WHENCE_CHOICES a tuple

  petedannemann

  committed
  00f7c86

• Specify client type

  petedannemann

  committed
  2544aca

• Make init one line instead of multiple

  petedannemann

  committed
  d3e0d8c

• Shorten _parse_uri_gcs

  petedannemann

  committed
  b2f38cf

• Use open instead of smart_open

  petedannemann

  committed
  0afb007

• Fix memory issue with RawReader

  petedannemann

  committed
  5b95e87

• Fix type hints

  petedannemann

  committed
  81f50ae

• Fix exists in test

  petedannemann

  committed
  2f8f22c

• Fix typo in smart_open_lib about schemes

  petedannemann

  committed
  7e07484

• Remove RawReaders and BufferedInputBase

  petedannemann

  committed
  b779ccd

• Remove unneeded arg passing in tests

  petedannemann

  committed
  66a0b33

• Fix bug with seek

  petedannemann

  committed
  ca90299

• Internal and doc stringed constants

  petedannemann

  committed
  ca4c26b

• Internal functions and doc strings

  petedannemann

  committed
  c4d1595

Commits on Jan 6, 2020

• Fix issue with double issue on upload and add __str__ and __repr__

  petedannemann

  committed
  79ee333

• Minor cleanup

  petedannemann

  committed
  9622bc6

• Fix flake8 errors

  petedannemann

  committed
  780c549

• Additional flake8 resolution

  petedannemann

  committed
  4382710

• Add source code encoding to test file

  petedannemann

  committed
  13872de

• Docstrings in imperative mode

  

  Peter Dannemann

  committed
  9b5c802

• Test grammar

  

  Peter Dannemann

  committed
  daae9fe

• Fix mock_gcs docstring

  

  Peter Dannemann

  committed
  86c24db

• Only support gs scheme

  

  Peter Dannemann

  committed
  f4c4781

• Remove additional occurences of removed gcs scheme

  

  Peter Dannemann

  committed
  e03e5fe

• Add test_read_past_end

  petedannemann

  committed
  7321bbd

Commits on Jan 7, 2020

• Clean up tests with class level decorator

  petedannemann

  committed
  5d1baf8

• Remove stub function

  petedannemann

  committed
  56112cd

• Use equality instead of in for scheme

  

  Peter Dannemann

  committed
  f4ad80b

• Fix repr and mock import

  petedannemann

  committed
  8611dba

• Merge branch 'gcs' of https://github.com/petedannemann/smart_open into gcs

  petedannemann

  committed
  8eb3e0a

• Specify ImportError

  petedannemann

  committed
  03ac2a9

Commits on Jan 8, 2020

• Use BytesIO in integration test

  petedannemann

  committed
  93e4b0f

• Explicit encoding in integration tests

  petedannemann

  committed
  2bcf8e3

• Remove unneeded variable in integration test

  Show description for 0a48ba4
  

  petedannemann

  and

  mpenkov

  authored
  0a48ba4

• Remove unneeded data variable

  Show description for 18ca5f8
  

  petedannemann

  and

  mpenkov

  authored
  18ca5f8

• Remove .format from test_gcs

  petedannemann

  committed
  ffa8083

• Merge branch 'gcs' of https://github.com/petedannemann/smart_open into gcs

  petedannemann

  committed
  f56909c

• Move RESUMEABLE_SESSION_URI_TEMPLATE to module scope

  petedannemann

  committed
  9579b1d

• Remove unnecessary explicit encoding

  Show description for aa90d64
  

  petedannemann

  and

  mpenkov

  authored
  aa90d64

• Remove unnecessary variable in read

  Show description for adf5d56
  

  petedannemann

  and

  mpenkov

  authored
  adf5d56

• Change assertion to use _REQUIRED_CHUNK_MULTIPLE

  Show description for 03a7d72
  

  petedannemann

  and

  mpenkov

  authored
  03a7d72

• Import clamp from s3

  

  Peter Dannemann

  committed
  115940a

• Add comment on buffering being read-only

  

  Peter Dannemann

  committed
  b735b7e

• Fix client docstring

  

  Peter Dannemann

  committed
  1d4805c

• Make SeekableRawReader internal

  

  Peter Dannemann

  committed
  0b5797f

• Add return value to seek in _SeekableRawReader

  

  Peter Dannemann

  committed
  6dd7e76

• Allow integration test to take a prefix

  

  Peter Dannemann

  committed
  94ce2bd

• Add doc to NotFound exception

  

  Peter Dannemann

  committed
  d2a4c2e

• Fix misleading log statement

  

  Peter Dannemann

  committed
  674ad80

• Various formatting changes

  

  Peter Dannemann

  committed
  910bdde

• Add additional assertion for min_part_size

  

  Peter Dannemann

  committed
  fb44cd2

• Clean up _upload_next_part

  petedannemann

  committed
  f17b9b1

Commits on Jan 9, 2020

• Improve UploadFailedError

  petedannemann

  committed
  5b86291

• Add docstring to terminate

  petedannemann

  committed
  52cb2d1

• Add additional clean up to close

  petedannemann

  committed
  e02fdab

• Remove useless terminate in SeekableBufferedInputBase

  petedannemann

  committed
  dcef33d

• Fix data type for status_code in UploadFailedError

  petedannemann

  committed
  8ddb98d

• Clean up UploadedFailedError msg

  petedannemann

  committed
  c3fc44a

Commits on Jan 19, 2020

• Start on mock tests

  

  Peter Dannemann

  authored and

  petedannemann

  committed
  7cc0509

Commits on Jan 20, 2020

• Add tests for mocks

  petedannemann

  committed
  bec8a6d

• Clean up registering dependencies

  petedannemann

  committed
  be21104

• Get initialize_bucket to work without gsutil

  petedannemann

  committed
  a760f71

Commits on Jan 23, 2020

• Change buffering to buffer_size

  

  Peter Dannemann

  committed
  dadda49

• Add copyright header, fix logging styles, and move result outside ctx manager

  

  Peter Dannemann

  committed
  343d5a2

• Change _upload_empty_part to debug msg

  

  Peter Dannemann

  committed
  8373740

• Clean up patching style

  

  Peter Dannemann

  committed
  ab4d936

• Add tests for smart_open_lib

  

  Peter Dannemann

  committed
  f8dd13b

• Add blank lines before constants to help readability

  

  Peter Dannemann

  committed
  1d2613c

• Add missing clean up of raw_reader in close

  

  Peter Dannemann

  committed
  9ec0b40

• Remove aws related credentials from gs tests

  

  Peter Dannemann

  committed
  a8c272e