The client is allowing creating invalid element in Cosmos that cannot be deleted or accessed

[Socolin]

Hello

I have some invalid elements that were created in a cosmos (containting / in the key) and I cannot delete them, do you have any solution about that ?

It would be great if this error could be catch sooner (server validation ? client validation too)

From https://docs.microsoft.com/en-us/dotnet/api/microsoft.azure.documents.resource.id?view=azure-dotnet

The following characters are restricted and cannot be used in the Id property: '/', '\', '?', '#'

The id fields should be at least validated client side to catch the problem sooner than when trying to delete an invalid entity that cannot be deleted (event with the bulk)

To Reproduce

ReproCosmos.zip

Expected behavior

• Server should prevent it
• Client should throw an exception

Actual behavior
No error until trying to read it or delete it

Environment summary
SDK Version: 3.13.0
OS Version Windows 10

[j82w]

The item can be deleted using the following guide.

The reason the SDK does not have the logic is it adds a lot of overhead. For creates the id is just in the body of the item. It would require the SDK to extract that id then validate the value. Then validate the id. This checks needs to be added in the service, but there are some hard problems with avoiding breaking customers that have items with invalid ids. All service request should be posted at https://feedback.azure.com/forums/263030-azure-cosmos-db?query=id

[Socolin]

The item can be deleted using the following guide.

Thanks it helped :)

Could you add a link to this, from where the doc talk about invalid ids ? here

The reason the SDK does not have the logic is it adds a lot of overhead. For creates the id is just in the body of the item. It would require the SDK to extract that id then validate the value. Then validate the id. This checks needs to be added in the service, but there are some hard problems with avoiding breaking customers that have items with invalid ids. All service request should be posted at https://feedback.azure.com/forums/263030-azure-cosmos-db?query=id

For the sdk I see multiple possibilities:

• Rename the current method FastCreateItemAsync() with no check and add a new method SafeCreateItemAsync that do the check and mark [Obsolete] the current method
• Add an optional parameter to CreateItemAsync that allow to validate the id.
• A mix between the 2 previous idea

[RomanKreisel]

I just ran in the same issue - we were able to create documents with IDs, which doesn't allow us to retrieve the same documents by their IDs anymore.
I accept, that older clients may have a problem with this breaking change, but you rolled out breaking changes before (#1725 for example), so I see no reason not to do it for this one.

You could even add an option (maybe to Microsoft.Azure.Cosmos.CosmosClient?) to use the old "quick'n'dirty" behavior.

Of course, the best place to fix it, might be the server itself. This way no client would be allowed to create documents with Ids which cannot be retrieved anymore.

[j82w]

This needs to be implemented by the service. The SDK should not be doing this validation. Please contact support to have the Cosmos DB service add the required checks.

[Socolin]

@j82w Already reported using the support last year, it took 3 weeks to the one in charge of our ticket to understand we wanterd to repot a bug and nothing has been done since, do you have a direct contact with the team in charge and let them know ?

[StefArroyo]

@Socolin Can you fill out this short form w/ the details of the ticket https://forms.office.com/r/qpY2yZUVBq? I can follow up with the team in charge on the status of this ask and reach out to you!

[Socolin]

@Socolin Can you fill out this short form w/ the details of the ticket https://forms.office.com/r/qpY2yZUVBq? I can follow up with the team in charge on the status of this ask and reach out to you!

I'm getting the following error message on your link: "You don't have permission to view or respond to this form"

[StefArroyo]

@Socolin Can you fill out this short form w/ the details of the ticket https://forms.office.com/r/qpY2yZUVBq? I can follow up with the team in charge on the status of this ask and reach out to you!

I'm getting the following error message on your link: "You don't have permission to view or respond to this form"

I've fixed the permission issue. Should be working now!

[ghost]

Closing due to in-activity, pease feel free to re-open.