Stream must be replayable to calculate a body hash

[lon9man]

Describe the bug

Hello,
trying to upload file to S3 in Jetpack Compose.
Uri for file i got from PhotoPicker.

Regression Issue

• Select this option if this issue appears to be a regression.

Expected behavior

file uploaded successfully

Current behavior

error: java.lang.IllegalArgumentException: Stream must be replayable to calculate a body hash

Steps to Reproduce

1. click button "Open Gallery"

@Composable
fun GalleryScreen() {
    var selectedUris by remember {
        mutableStateOf<List<Uri>>(emptyList())
    }

    val multiplePhotoPickerLauncher =
        rememberLauncherForActivityResult(contract = ActivityResultContracts.PickMultipleVisualMedia(),
            onResult = { uris ->
                selectedUris = uris
            })

    fun onOpenGallery() {
        multiplePhotoPickerLauncher.launch(
            PickVisualMediaRequest(ActivityResultContracts.PickVisualMedia.ImageAndVideo)
        )
    }

    Row() {
          Button(onClick = ::onOpenGallery) {
              Text(text = "Open Gallery", color = MaterialTheme.colorScheme.onError)
          }
    }
}

2. prepare additional parameters (bucket, key, metadata) and run fun upload

private suspend fun upload(bucket: String, key: String, metadata: Map<String, String>, uri: Uri) {
    val inputStream = context.contentResolver.openInputStream(uri)
        ?: throw IllegalArgumentException("Unable to open input stream for URI: ${config.uri}")

    try {
        inputStream.use { stream ->
            S3Client.use { s3 ->
                s3.putObject {
                    bucket = bucket
                    key = key
                    metadata = metadata
                    body = ByteStream.fromInputStream(stream)
                }
            }
        }
    } catch (e: Exception) {
        Log.d("TAG", "$e")
        throw e
    }
}

Possible Solution

No response

Context

No response

AWS SDK for Kotlin version

2.0.21

Platform (JVM/JS/Native)

Native

Operating system and version

Ubuntu 20.04.5 LTS

[lauzadis]

ByteStream.fromInputStream needs to assume that the given stream is not replayable because any given InputStream may or may not be replayable.

If you have direct access to the file through the uri, you can set the body to: File(uri).asByteStream(), which does not use an InputStream and is correctly marked as replayable.

We can only support replayable bodies for standard SigV4 signing because we need to include the checksum of the body in the request. Calculating the checksum of a non-replayable body would fully consume it, leaving us unable to send it in the request itself.

[lauzadis]

I've proposed a small fix to infer the replayability of a given InputStream using markSupported(), it won't help you in this case because I believe context.contentResolver.openInputStream returns a FileInputStream which is still not replayable.

smithy-lang/smithy-kotlin#1187

[lauzadis]

We've merged the fix I noted above and it should be available in today's release. Do you have any other questions / concerns?

edit: Fix will be available in Monday's release

[lon9man]

@lauzadis

QUESTIONS

I've proposed a small fix to infer the replayability of a given InputStream using markSupported(), it won't help you in this case because I believe context.contentResolver.openInputStream returns a FileInputStream which is still not replayable.

smithy-lang/smithy-kotlin#1187

1. how this fix should be used? or it is some internal logic, which will be used automatically and will show some error for developer?

If you have direct access to the file through the uri, you can set the body to: File(uri).asByteStream(), which does not use an InputStream and is correctly marked as replayable.

3. AFAIU uri doesn't have direct access to file. i tried next code to copy into real file. after that it works. BUT maybe exists some better approach to make it without additional copy?

fun fileFromContentUri(context: Context, contentUri: Uri): File {
    val fileExtension = getFileExtension(context, contentUri)
    val fileName = "temporary_file" + if (fileExtension != null) ".$fileExtension" else ""

    val tempFile = File(context.cacheDir, fileName)
    tempFile.createNewFile()

    try {
        val oStream = FileOutputStream(tempFile)
        val inputStream = context.contentResolver.openInputStream(contentUri)

        inputStream?.let {
            copy(inputStream, oStream)
        }

        oStream.flush()
    } catch (e: Exception) {
        e.printStackTrace()
    }

    return tempFile
}

thanks!

[lauzadis]

1. The fix affects internal logic, you don't need to modify your application code to get the change.
2. You're right, it's very difficult to get a File handle from content URI in Android, I couldn't find anything to suggest. One option is to continue using openInputStream(uri) and then wrap that in a BufferedInputStream which is now supported after that fix I linked earlier.