[Internal] Direct : Refactores msdata/direct branch #4465

…andler for .NET 6 and above (#3762) * initial commit * removed unneeded usings * added validation callback, still needs tests * nits + fixes * added additional test * test change * removed unneeded Dispose calls * removed unnneed dispose calls * requested changes * added pooledConnectionLifetime as client option * nit Co-authored-by: Kevin Pilch <me@pilchie.com> * Update Microsoft.Azure.Cosmos/src/HttpClient/CosmosHttpClientCore.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/src/CosmosClientOptions.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * suggested changes * remove test, reorder usings * updated contracts * removed all non XXXAPI.json changes from UpdateContracts run * removed public surface, added random timespan * removed change from unrelated file * Update Microsoft.Azure.Cosmos/src/HttpClient/CosmosHttpClientCore.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * added thread safe random method * nit * fixed merge mistake * added reflection failsafe/error tracing * nits * added back removed if * fixed formatting * changed random method, fixed serverCertificateCustomValidation --------- Co-authored-by: Kevin Pilch <me@pilchie.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…3805) * Fixing test * New baseline * Undo some changes

…ata processing task in background. (#3783) * first draft * remove failure count test * refactporing * code refactor * create task with timeout * fix test * code refactoring * fix timeout code * space fix * not failing if processor is taking time * fix procrsser test * code refactor * refactor and test fix

* Basic changes to introduce move operator * Added "from" object in patch spec operation. Added testcase block. * Fixed testcase. * Changes made to address comments' * Added comment regarding enum mutations * Formatted comment Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Moved summary location. * Ran UpdateContracts.ps1 --------- Co-authored-by: Amaan Haque <t-amaanhaque@microsoft.com> Co-authored-by: Amaan Haque <amaanhaque@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Support cleaning * wire previous content delete * as text * with variable * another test * param with types * as string * no delete * no quotes * undoing * re-adding quotes * testing empty * trying another test * readding version * fixing publishing artifacts * fixing parameter * Fixing official pipeline * version 5 * fixing main pipeline * test with true * using start time * nightly preview * passing parameters to pack * Fixing nuget version * arguments on the nuget pack * folder structure * testing v5 * Using only content * Removing currentDate

…tic files (#3797) * Direct Package update and replacing dagnostic files * Resolve merge conflicts * Running updateCOnstracts script * Removed LinqTranslationWithCustomSerializerBaseline file * Adding isDistributedTracingEnabled flag * Running update contracts * Running update contracts * Running update contracts * fix test * Code cleanup for test fix * Code cleanup for test fix * Making regex expression readable * Adding comment for regex expression --------- Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

* Add config changes * Polishing automerge config

…cas along with `Unhealthy`. (#3820) * Code changes to add aggressive validation logic. * Code changes to enable aggressive validation for all regions. * Code changes to pull in msdata cosmos.direct changes related to aggresive validation logic. * Code changes to make minor cosmetic changes. * Code changes to address review comments.

…ode when EnableContentResponseOnWrite is false (#3814) * Do not call serializer if ResponseMessage.Content is empty. * Add unit test * Update unit tests * Remove unused usings --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…#3822) * Add doc * Move benchmark * Fixing texts

…Microsoft.Azure.Cosmos.Encryption.Custom (#3799) * cosmos version change * changing preview to release * resolving code review comments --------- Co-authored-by: Santosh Kulkarni <66682828+kr-santosh@users.noreply.github.com>

* release 3.30.0 * added changelog * updated changelog * updated changelog * suggested change to changelog * updated changelog --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Code changes to add msdata/direct sync-up documentation. * Code changes to address review comments. * Code changes to address further review comments. * Code changes to address minor review comments. * Removed internal links.

* add trim support * Added some test coverage * address reviews --------- Co-authored-by: Minh Le <leminh@microsoft.com>

…3832) * add fix * Add cultural info to test to verify correct behavior * address pr review to restore to restore culture * fix comment --------- Co-authored-by: Minh Le <leminh@microsoft.com>

…and FetchDataEncryptionKeyAsync to get DEK without and with raw key respectively. (#3809) * added raw key to MdeEncryption * adding ray key to Mde Algo * test case changes * resolving code review comments * code optimization to reduce keyvault calls * removed Microsoft.Data.Encryption.Cryptography nuget package * added api for dek with raw key * resolved code review comments * adding change log * code review changes

* Initial commit * Restored settings.json changes. * Update * Addressed comments; still need to be tested using Emulator. * Fixes after test run. * Ignored the computed property tests based on the sync this morning (to allow for preview release). * Suite0 fixes. * Test update. * Suite0 fixes

…es (#3818) * add opentelemetry and application insights samples * address pr comments

…nToSQL.cs (#3722) * Ensure enum as string is preserved for custom serializer * Failing test * Added failing tests * Updated requested names * Ignore result of test for now * Added additional comment on why the test is ignored * Replaced with sample code * Remove ignore attribute from tests, documented misbehavior for future use * Updated comment --------- Co-authored-by: leminh98 <leminh.ams@gmail.com>

…tensions (#3724) * Added the remaining Cosmos Type checking functions to the CosmosLinqExtensions * Added comments requested * Updated comment * Updated baseline * Improve readability of dictionary initialization * Aligned with code style guide * Revert change to baseline * Executed update baseline script --------- Co-authored-by: neildsh <35383880+neildsh@users.noreply.github.com> Co-authored-by: leminh98 <leminh.ams@gmail.com>

… since PackageLicenseUrl is deprecated (#3847) * proposal to add PackageLicenseFile since PackageLicenseUrl is deprecated. NuGet/Home#4628 * adding attribute Visible=false

…ests. (#3845) * first draft * second draft * 3rd draft * remove untouched file * test fix * fix order * change order * refactor * skip network activities in test * remove network attributes

* SDK 3.34.0: Adds version bump and changelog * adding changelog changes * added a missing PREVIEW PR * Update changelog.md Co-authored-by: Justine Cocchi <jucocchi@microsoft.com> * Update changelog.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * removed 3840 as it was not committed * change text for 3832 * fix merge issue * add 3724 * Update changelog.md Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update changelog.md Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * including 3845 --------- Co-authored-by: Justine Cocchi <jucocchi@microsoft.com> Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…3864)

…ch (#3860) * Linking limit documentation to Container.CreateTransactionalBatch(PartitionKey) method * Resolved PR comments * Links update * Using learn.microsoft instead of docs.microsoft in the links --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* initial commit * cleanup * update test output * cleanup * typo * Pr comments

* first draft * redesign * ädd link * updated observability url

* initial commit DONT REVIEW * fixes and documentation * Apply suggestions from code review Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * requested changes * Apply suggestions from code review Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * name changes * readme changes * nits + changing case of parameters file --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

URL typo.

… latest direct (#3877) * upgrade to 3.31.0 * add more regions * enable dt for operations * updated contract file

…tewayRequestOptions (#3836) * Integrated cache: Add BypassIntegratedCache to DedicatedGatewayRequestOptions Currently, integrated cache is used by default for Dedicated Gateway. Customers cannot skip cache for particular requests or data unless they shift to multi-tenant Gateway,which will lose the benefits of Dedicated Gateway. For customers to have more control over integrated cache, we're introducing a new "RequestOption" called "BypassIntegratedCache". This option will allow the customer to decide whether to use integrated cache for each request or not. If this value is set to true, the item/query will be served from backend and won't be cached in Dedicated Gateway. * Move this feature to public preview * Address comments 1. Add more tests 2. Add more detail and example code for BypassIntegratedCache * Revert changes in EncryptionCustomAPI --------- Co-authored-by: Jiajun Peng <jiajunpeng@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…on 3.34.0 (#3874) * chaging Microsoft.Azure.Cosmos support version * resolved merge conflicts

…#3866) * Added tracing when converting HTTP Timeout to 503 * Fixed tracing when converting HTTP Timeout to 503 * Resolved PR comments * Using ITrace as part of ClientSideRequestStatisticsTraceDatum * Refactoring * Test update * Unit tests fix

* first draft * add filter * revert csproj * fix sample * changed log message * remove unused library

…on headers (#3882) * Adding ODE and RequiresDistribution Headers * Fixed comments * Updated parameter in SwitchToFallbackPipelineAsync * Renamed TryUnwrapContinuationToken to UnwrapContinuationToken --------- Co-authored-by: neildsh <35383880+neildsh@users.noreply.github.com>

#3883) * Made EnableOptimisticDirectExecution a public flag * Updated contract

…nality (#3801) * Direct Package update and replacing dagnostic files * Resolve merge conflicts * Running updateCOnstracts script * Add code changes for distributed tracing open telemetry changes * Add distributed tracing tests * Updated tests for distributed tracing * Addin traceID for diagnostics * Running update contract script * Removed LinqTranslationWithCustomSerializerBaseline file * Adding isDistributedTracingEnabled flag * Running update contracts * Running update contracts * Updates based on differnt code review comments * Running update contracts * Running update contracts * Running update contracts * fix test * Code cleanup for test fix * Running Update contracts * resolving merge conflicts * resolving merge conflicts * Set EnableDistributedTracing to true for performance tests * Benchmark project change for distributed tracing * Updating tests * Updated unit tests * Updated unit tests * Updated tests and constructors based on review comments * Updated scope name in recorder * Updated distributedOtel tests to cover more scenarios * Updated distributedOtel tests * Reverting benchmark performance test changes * Update DistributedOpentelemetry tests * Update test cleanup * Update distributed tests with custom builder * Update distributed open telemetry tests * Update contracts * Cleanup files * Update distributed Otel tests * Update distributed Otel tests * code refactoring * fix custom listener * Update direct package to 3.31.1 * Code clean up * Update tests with display name --------- Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

* CosmosClient documentation improvements * Cref fix * Link fix * Documentation fix * Typo fix --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…sts trace (#3887) * enable request level in end to end * made some changes * fix tests * fix display name * hardcoded containername and databasenam * fix tests * temp * fix tests * update contracts * fix tests * fixed display name

) * sdk design for client telemetry * Otel design * update optel design * added more nformation * updated ct design * remove otel design * Client Telemetry Design * update typos * fix typos * fix typos * added limitation * updated docs * updated doc * updated text * Update docs/observability.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update docs/observability.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update docs/observability.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update docs/observability.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update docs/observability.md Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * move stuff here and there. --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

…t 2 (#3903) * updated doc * Update docs/observability.md Co-authored-by: Justine Cocchi <jucocchi@microsoft.com> * updated text --------- Co-authored-by: Justine Cocchi <jucocchi@microsoft.com>

… 6 Seconds. (#3902) * Code changes to reduce default request timeout to 6 seconds. * Code changes to update API doc default request timeout to 6 seconds.

…#3835) * Code changes to add replica health status in diagnostics. * Code changes to fix performance test build failure. * Code changes to add health state capture logic in address cache. * Code changes to fix benchmark test execution. * Code changes to add tests to validate health state cache. * Code changes to reduce default request timeout to 5 seconds. * Revert "Code changes to reduce default request timeout to 5 seconds." This reverts commit 139f37e588fc9dfed608431f4186c567a080e622.

* Initial Commit DO NOT REVIEW * bug fix, needs Direct Package Changes * fix for change feed and query plus tests * clean up * query + clean up --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

* inital commit * cleanup * test cleanup * PR comments * PR comment

… default in Preview mode (#3909) * Setting EnableODE to true by default in Preview Mode. * Added seperate if block for default value * Updated property * Removed unused Usings * Updated contracts * Updated test * Updated directive indentation

* Added links to PatchItems docs * Undo changes from internal file

…Direct` Package to `3.31.2` (#3918) * Code changes to bump up the direct version. * Code changes to mark the Israel Central region as public. * Code changes to update contracts. * Code changes to fix test failure. Some clean ups. * Code changes to add detailed message for open channels count.

* release PR * updated changelog.md * more changelog updates

* release PR * updated changelog.md * more changelog updates * changelog fix * Update changelog.md * Update changelog.md

* Binary Serilaization Response test * Added new header SupportedSerializationFormats * Modified existing use of CosmosSerializationFormatOptions * Modified tests and removed unused code * Addressed comments * Added more negative cases * Revert changes * Added spaces * Addressed comments * Addressed comments * Removed SupportedSerializationFormats from Headers file * Removed unused JsonSerilazationFormats option * Addressed comments * Addressed comments * Addressed comments * Addressed comments * Added new enum TransportSerializationFormat * Added new enum TransportSerializationFormat * Addressed comments * Removed unused parameter * Addressed comments * updating API * remove tests * Text fixes * fix typo * remove TransportSerializationFormat header * text reverts * revert * test update * PR comments * remove test owner headers HeadersValidationTests.cs * PR comments - remove unsupported tests and scope client --------- Co-authored-by: Heet <detrojaheet@gmail.com> Co-authored-by: neildsh <35383880+neildsh@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ections in parallel. (#3939)

…3834) * Support newtonsoft member access via ExtensionData * Return null instead of empty string * Added tests for select & where * Updated baseline with note --------- Co-authored-by: leminh98 <leminh.ams@gmail.com>

… retries (#3944) * Fix HttpTimeoutPolicies to not accidentally suppress retries * Removing HttpTimeoutPolicy.MaxRetryTimeLimit altogether

* version bump * changelog * contract

* SDK 3.35.1: Adds version bump and changelog * Update changelog.md * Update changelog.md * Update changelog.md * Update changelog.md * Update changelog.md

…ic.Core (#3957) * Removing 1 * Removing 2 * Removing 3

… Feature for Preview (#3951) * Code changes to add replica validation feature in cosmos client options. * Code changes to upgrade the cosmos direct version to 3.31.3. * Adding emulator test to cover replica validation. * Code changes to address cosmetic clean ups. * Code changes to address review comments. Fixed preview build failures. * Code changes to enable replica validation for preview package by default. * Code changes to address review comments. * Code changes to fix preview unit tests. * Code changes to disable environment variable at the end of the test.

…ion 3.35.1-preview (#3956) * changing cosmos preview version * updating build file --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…cBot decommissioning (#3966) * Add prIssueManagement.yml to onboard repo to GitOps.ResourceManagement as FabricBot replacement Owners of the FabricBot configuration should have received email notification. The same information contained in the email is published internally at: https://aka.ms/gim/fabricbot. Details on the replacement service and the syntax of the new yaml configuration file is available publicly at: https://microsoft.github.io/GitOps/policies/resource-management.html Please review and merge this PR to complete the process of onboarding to the new service. * Deleting fabricbot.json --------- Co-authored-by: microsoft-github-policy-service[bot] <77245923+microsoft-github-policy-service[bot]@users.noreply.github.com>

…misticDirectExecution is set to true in 3.35.0-preview package (#3955) * Updated emulator and baseline tests to not fail when ODE is set to default true in PREVIEW mode * Fixed QueryAsync() test * Fixed QueryAsync() in EndToEndTraceBaselineTests * Undid changes to IndexMetrics baseline file * Updated EndToEndTraceWriterBaselineTests.QueryAsync xml * Updated xml * Updated xml to have request options tag

…#3969)

…3917) * Fixed malformed continuation token issue where Exception was not CosmosExceptionan and did not have the correct Status and Sub Status codes. * Fixed incorrect indentation * Added type check for incoming exception * Replaced if/else with extra catch block * Moved fix to a higher point in the call stack * Removed unused Usings * Updated test code --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ation Feature Through `CosmosClientOptions` And Environment Variable (#3974) * Code changes to use client options to enable or disable replica validation. * Code changes to fix preview build failures.

#3668) * string.Compare supported with LINQ to SQL * Update tests * Update test name * Update tests * Add test * Create helper ReverseExpressionTypeForStrings * PR feedback * Update tests * Update base line --------- Co-authored-by: Aditya <adityasa@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* first draft * fix code * included feedback * flip condition * updated docs * Update docs/observability.md Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update observability.md * updated contract --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Refactoring: base classes for operations. * Updating comments. * Adding new line at the end of the file. * Fixing code review points. * Restore PrepareAsync to be virtual.

* Updated change log and bumped up the version. * Changing the version to 3.35.2 * Code changes to address review comments. * Code changes to make minor fixes. * Code changes to move some fixes into preview.

* Draft of local-quorum documentation * Adding experimental to header * Adding cross-region read guarantees * Reads Bounded clarification * Adding account consistency step also * Non-Prod usage note at top * Addressing review comments * Some more refinement

…archical partitioning) (#3979) * Hirarchical pk bug fix * Hirarchical pk bug fix * Hirarchical pk bug fix * Hirarchical pk bug fix * Hirarchical pk bug fix * testing new version * adding more tests * adding more tests * adding more tests * code review changes * test fix * test fix * test fix * test fix --------- Co-authored-by: Nalu Tripician <27316859+NaluTripician@users.noreply.github.com>

…endation (#4004) * Update changelog.md This is a recommendation for customers if they would like to use the ODE features. * Updated release notes for ODE

…ion pipeline (#3839) * Infrastructure for performance testing with ODE pipeline. * Resolve comments * Removed randomization from data creation process * Fixed comments * Removed Query and EnableODE from QueryStatisticsMetrics, as they do not relate to query statistics. * Removed try catch to make CreateItemAsync call always succeed * Removed one liner functions * Removed code from MetricsSerializer and QueryStatisticsDatumVisitor files * Fixed comments * Removed request Charge check * Bug in Debug Assert * Test * Bug in debug assert fix * Fixed second bug in Metrics Accumalator class * Added ignore flag to ode perf tests so that they do not run on every loop build * Added comment explaining the Ignore flag.

* Added code to throw exception if ODE continuation token goes into non ODE pipeline * Removed count variable * Updated test name * Removed ODE continuation token logic from caller class * Simplified code * Fixed comments * Updated continuation token cast * Removed const string for continuation token * Added Ignore flag for test * Added baseline test * Updated baseline test

* Updated change log and bumped up the patch version. * Code changes to update the change log message.

…nd events using custom listener (#4021) * custom listener example * removed unwanted code * add comments * fix appsettings * revert changes

…on) + Azure Cosmos DB typo (#4031) * Documentation link fix * Fixed Typo "Azure CosmosDB"→"Azure Cosmos DB"

* Adding metrics for Benchmark tool. * Adding OpenTelemetry. * Revert "Adding OpenTelemetry." This reverts commit c7da088. * Telemetry for windowed percentiles. * OpenTelemetry, AppInsights and Dashboard. * Removing DiagnosticDataListener. * Code styling, comments and clean-up. * Fixing issues with dashboard. * Fixing positions of charts on the dashboard. * Fixing the dashboard. * Updating titles and subtitles. * Removing ILogger and other not required references. * Fixing code review points. * Fixing issues after rebase. * Removing unnecessary changes. * Fixing code review points. * Adding metrics for Benchmark tool. * Adding OpenTelemetry. * Revert "Adding OpenTelemetry." This reverts commit c7da088. * Telemetry for windowed percentiles. * OpenTelemetry, AppInsights and Dashboard. * Removing DiagnosticDataListener. * Code styling, comments and clean-up. * Fixing issues with dashboard. * Fixing positions of charts on the dashboard. * Fixing the dashboard. * Updating titles and subtitles. * Removing ILogger and other not required references. * Fixing code review points. * Fixing issues after rebase. * Removing unnecessary changes. * Fixing code review points. * Fixing code review points. * make MetrcisCollectorProvider non static and remove locks * fix * fixes * use static class name TelemetrySpan.IncludePercentile * use app insights connection string * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Program.cs * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Program.cs * rename AppInsightsConnectionString * fix * fix comments * fix if AppInsights c string is not set * summary * fix * remove unnecessary collector types * remove unnecesary metere provicer * add event source * remove folder * fix * split success and failed latencies * fix * fix --------- Co-authored-by: David Chaava <chaava01@gmail.com> Co-authored-by: David Chaava <v-dchaava@microsoft.com>

…ress Refresh (#4039) * Code changes to fix unobserved exception during background address refresh. * Code changes to add exception handler in task. * Code changes to fix null ref exception. * Revert "Code changes to fix null ref exception." This reverts commit 83f90d5. * Revert "Code changes to add exception handler in task." This reverts commit c49ed81. * Code changes to address review comments. * Revert "Code changes to address review comments." This reverts commit d2b9f6b.

…4042) * Added small remark for GetContactedRegions method documentation * Moved to remarks

…ata to service (#3900) * first draft * comment other pipelines * pint variables * commnet other pipelines * added env variable * minor changes * update env variable * print env variable * add space in end * fix test * fix tests * fix test * fix tests * remove response interceptor * logs * debuug mode * 3failing test to print llgs * minor refactoring * 2nd windows-2019 * fix ct tests * 2remove debugging * fix tests * revert * ncomment pipelines * fix test * minor changes * release and emulator pipeline * update pipelines * ignore abstract class test * fixing pipeline * refactor code * change it to class name to run tests * added emulator setup * 1 temp commit * env variable * renames env variable * fix tests * add condition * fix tests * reorder env variable * revert pipeline * did some clean up * change to revert * Revert "change to revert" This reverts commit 03db3c104505dc7b8f3cea267835c92ca530f8f4. * fix typos * throw if exception intercepter is null * remove modelling changes * removed virtaul * Update Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.EmulatorTests/Utils/HttpHandlerHelper.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * added condition for pipelines * Revert "added condition for pipelines" This reverts commit f9a208cd28e01badee97a2eb770a486cea67c1f0. * changed cond * fix codn * more enhancement * testing for release pipeline * refactore code and using test category * added comments on test * refactor pipeline code * fix variables * fix pipeline --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* refactored code * implemented review comments * test fix * fix tests * fix test * fix test * logger fix * update contract * fic test * updated benchmarks

) * Added customer-reported label * Changing condition * padding * more padding * permission name * padding

…upload to storage (#3926) * azure-cosmos-dotnet-v3/issues/3889 add diagnostics data capturing during bechmark and storing into blob storage after finish * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/README.md * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/custom-script.sh * fix bug * fix review comments * fix comments * fix comments * fix case * add tests and refactoring * fix * unify logging * add summaries * fix method summary * fix BOM * fix review comments * fix comment * fix line breaks * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/ARMTemplate/README.md * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/README.md * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/README.md * catch exceptions * add container prefix * ResultStorageContainerPrefix * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/execute.sh * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/custom-script.sh * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/BenchmarkConfig.cs Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/BenchmarkConfig.cs Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Fx/DiagnosticDataListener.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * fix comments * fix comments * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/README.md * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/execute.sh * make BlobCLient Lazy singleton * new file: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/README.md modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/azuredeploy.json * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/README.md * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/execute.sh * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/scripts/execute.sh * check on diagnostic colletiong * remove locks and improve logs appending * removed unnecesary directory * removed unnecesary directory * removed unnecesary directory * new file: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/ARMTemplate/README.md * add dashboard * fix arm template * change branch * fix * add dashboard name * fix dashboard * add logging * fix * trace error * fix devide zero * add trace errors * fix * fix * fix * fix * fix * migrate to text writer * fixes * diagnostic logs * add diagnostic logs * remove flush and reset * metric collection window lock * collection window * force flush every n seconds * fix bug * fix * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/README.md Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * change deafult metric interval * constant * fix container creating conflict issue * change azuredeply branch name * remove ArmTemplate folder * fix DiagnosticLatencyThresholdInMs default value --------- Co-authored-by: David Chaava <v-dchaava@microsoft.com> Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…e plots queries for metrics with a workload name prefix, depending on the benchmark workload type. #4048 (#4053) * Merge remote-tracking branch 'origin/master' into users/v-dchaava/benchmark-diagnostics/3889 * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/AzureVmBenchmark/README.md * add metrics prefixes * fix chart metrics names * fix dashboard queries according selected workload type --------- Co-authored-by: David Chaava <v-dchaava@microsoft.com>

…t flag status (#4050) * first draft * tets fix * fix dependent projects * reduce refresh time in tests * fix tests and added comments * fix diagnostic handler fix * fix test * adding test * ret pushmove console * fix test * provide options to enable/disable this featire in benchmark and ctl proj * updated trace message Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * remove import * updated traces Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * test fix * remove null assignment * fix test --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ctRef parameter (#4066) * fix benchmark run command using OSSProjectRef parameter * remove ShouldUnsetParentConfigurationAndPlatform=false --------- Co-authored-by: David Chaava <v-dchaava@microsoft.com>

* initial commit * some pr comments, WIP * Refactor * more * Public constructors and modify accumulators * accumulator updates and undo test changes * add test * PR comments * bug fix * ToString() refactor * contract updates * test updates * small fixes * text fix * Update accumulators * fix * PR comments * small fix * Rename BE -> ServerSide * more renaming * Update API and tests * separate public and internal classes * API update * change namespace * Pr comments * public constructors and bug fix * API updates * renaming and test updates * PR comments * more PR comments * PR comments, test additions * API updates and more tests * tests and pkrangeid update * PR comments * more PR comments * smol test fix * PR comments - renaming properties and constructor rehash * contract update * seal classes and private fields. * update indexHitRatio calc * mocking refactor to abstract classes * contract updates * PR comments - Update documentation

…nuation tokens (#4052) * partial test * Tests and error handling update * update error message * typo * update original err msg * combine tests * test cleanup * undo error message update

…cs as EventSource (#4040) * Adding metrics for Benchmark tool. * Adding OpenTelemetry. * Revert "Adding OpenTelemetry." This reverts commit c7da088. * Telemetry for windowed percentiles. * OpenTelemetry, AppInsights and Dashboard. * Removing DiagnosticDataListener. * Code styling, comments and clean-up. * Fixing issues with dashboard. * Fixing positions of charts on the dashboard. * Fixing the dashboard. * Updating titles and subtitles. * Removing ILogger and other not required references. * Fixing code review points. * Fixing issues after rebase. * Removing unnecessary changes. * Fixing code review points. * Adding metrics for Benchmark tool. * Adding OpenTelemetry. * Revert "Adding OpenTelemetry." This reverts commit c7da088. * Telemetry for windowed percentiles. * OpenTelemetry, AppInsights and Dashboard. * Removing DiagnosticDataListener. * Code styling, comments and clean-up. * Fixing issues with dashboard. * Fixing positions of charts on the dashboard. * Fixing the dashboard. * Updating titles and subtitles. * Removing ILogger and other not required references. * Fixing code review points. * Fixing issues after rebase. * Removing unnecessary changes. * Fixing code review points. * Fixing code review points. * make MetrcisCollectorProvider non static and remove locks * fix * fixes * use static class name TelemetrySpan.IncludePercentile * use app insights connection string * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Program.cs * modified: Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Program.cs * rename AppInsightsConnectionString * fix * fix comments * fix if AppInsights c string is not set * summary * fix * remove unnecessary collector types * remove unnecesary metere provicer * add event source * remove folder * fix * split success and failed latencies * Code refractor to use EvenSource design pattern for metrics * Fixing build breaks * Removing BenchmarkExecutionEventSource * Fixign misc things * Some extra cleanup * use TimeSpan except milliseconds * fix metrics publication * fix metrics publication * move tests to benchmark folder * move back benchmark test * use background task for flushing metrics * remove sync metrics flushing * split failed and success operations * fix latenclies charts * fix benchmark run command * remove ShouldUnsetParentConfigurationAndPlatform=false --------- Co-authored-by: Mikhail Lipin <v-milipin@microsoft.com> Co-authored-by: David Chaava <chaava01@gmail.com> Co-authored-by: David Chaava <v-dchaava@microsoft.com>

…3934) * initial fix, needs testing on prod * test fix * clean up pr * query rework * refactors previous changes * requested changes and bug fixes * nits * requested changes * bug fixes * start of test * added test * nit: changed name of EffectivePartitionKeyRanges to EffectiveRangesForPartitionKey * Address code comments * Address code comments * saving work * addresses code comments * nit, spacing * PartitionKeyHash fixes * Fixes bugs in tests * Removed bad method, added additional test coverage * Removed EffectivePartitionKeyString use * test fix * requested changes * Requested changes * fixed test * Test fix * Added comment --------- Co-authored-by: SrinikhilReddy <nanarava@microsoft.com>

* preliminary change * Add some more boiler plate code * move all linq test to the same folder; add some groupBy test * fix references error in test refactoring add code for group by substitution. Still need to adjust binding post groupby * preliminary for the groupby functions with key and value selector * trying to change collection inputs for group by * Undo the LINQ GROUP BY part * fix accidental changes --------- Co-authored-by: Minh Le <leminh@microsoft.com>

#4071) * first draft * fix tests * fixes * fix tests * remove consoles * added exception * remove comment * fix tests * fix test * rev comments * rev comments * refactor code * remove log from api exception

* bump version and changelog * added apis * Update changelog.md

* Initial commit * Addressed comments.

* pk to result container * set pk * pk value fix * update run.sh * remove changes value * remove telemetry service end point * cleanup

* making necessary ownership change * made change to ownerships * header test * Call to TryCreate instead of Create in Responsemessage * Add baseline test infra for index metric parser * update baseline files * Add parse retry logic * Update headers test * address code review * address code review * fix tests * Update csproj file * Adopt the new header * update the response to parse with text instead of base 64 * test for headers adoption of uri escape * Add URI Decode logic * Update baseline * Update with the new header name from back end * update the query parsing requirement * New Index Metrics DOM * fix build error * Code clean up * Address code review * Turn off switching to V2 * Fix test * fix test errors * Address code review comment * addressed code review * removed the empty entity * update test parse * update test --------- Co-authored-by: Minh Le <leminh@microsoft.com>

* first draft * refactor * fix tests * fixed condition

…istribution Plan (#3988) * First commit. * Added remaining classes for ClientQL structure * Added ClientQLDeserializing class and added CoordinatorDistributionPlan folder * Added support for all Enumerable and Scalar Expressions * Added baseline tests for testing CoordinatorDistributionPlan deserializing * Made ClientQL objects immutable * Added error and null checks for Value calls * Updated List<> with IReadOnlyList<> * Made most functions in the Deserializing class private and static * Added static constant class for Enumerable expressions * Added null checking for arrays * Removed null checks from deserializing array functions * Removed support for JavaScript * Removed support for Unwind * Function names changed * Removed few functions. * Updated constants class * Function Formatting for ClientQL Deserializing (#4062) * Adding error handling for Deserializing functions * Finished updating code to remove all dependency on Newtonsoft.Json * Removed try catch for all upper level functions * Resolved comments * Resolved comments pt2 * Updated error message * Resolved comments pt3 * Changed parameter types from int to long * Removed ClientQLDelegate * Syntax Fixes * Removed ClientQLFlattenEnumerable file. This is JS. * Fixed List helper functions * Made singleton constructors from public to private * Updated the DeserializeClientQLBinaryLiteral function * Renamed ClientQL to QL * Fixed variable names * Updated more variable names * Removed support for Type * Removed all extra newlines * Added null checks * Updated the name CoordinatorDistributionPlan to ClientDistributionPlan * Removed all support for Cassandra, Mongo and Binary Literal * Updaed ClientQL to Cql * Updated baseline test class property.

…stic Direct Execution code path (#4090) * Added query validity function on Ode code path * Fixed syntax * Updated to use string search instead of query parsing * Updated string search to now be regex * Changed location of caller for QueryValidityCheck() * Updated regex string * Added extra test coverage * Added const string to error messages * Added compile flag to Regex * Fixed comments * Added missing null reference coverage * Removed extra foreach loop in test * Removed useQueryPlan bool in test code

…DEAsync (#4105) * Fixed typos and made test more readable * Another typo

* Add support for translation to REgexmatch * Add test and fix some indexing issues * remove visit explicit, add some comment. Update public contract and added the baseline for the test * add the missing baseline * added test * address code review * update csproj --------- Co-authored-by: Minh Le <leminh@microsoft.com>

* Revert "[Internal] Client Telemetry: Refactors code for collectors (#4037)" This reverts commit e2311a9. * Revert "Revert "[Internal] Client Telemetry: Refactors code for collectors (#4037)"" This reverts commit f04234b. * firdst draft * initialize object * null handle * update contracts * compilation charges * fix tests * public API changes * add docs * contract updated * fixed tests * by default switch of te;emetry in sdk * fix tests * fix assertion * incorporate review comments * fetaure flag fix in script * switch case * add test * fix tests * fix test * fixed run.sh * minor changes * code refactor * changed default values and fix tests

* Update azure-pipelines-nightly.yml * Newlines in variables sections

…container is getting created (#4109) * Showing Estimated Cost only when new container is getting created * read container to get container response * disable client telemetry by default * removed unused imports * resolve merge conflict * fixed name * fix container not found * removed the message * Update Microsoft.Azure.Cosmos.Samples/Tools/Benchmark/Program.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * removed line space --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…etry response (#4097) * adding tets * wip * wip2 * fix code * add tests * fix test * fix test * remove consoles * fix indent and remove unused imports * internal to private rollback * added docs * removed unused imports * added exception in message * fix exception catching

…ng 1-byte user strings (#3400)" (#4108) This reverts commit 9140890.

…n names (#4016) * Allow ComosClientOptions to take ApplicationRegion and ApplicationPreferredRegions in multiple region name formats. This is a proposed fix for - #2330 * Address PR comment to avoid duplicating list of names. * Remove the map table cache The map table is only used on initialization, so there's no need to keep a cache of it for the lifetime of the application * Only convert the region names when the client is initializing The cache is created before converting all the names, so it only needs created once, but doesn't remain for the entire lifetime of the application * Update tests * Make RegionNameMapper an instantiable class Instead of having a prepare/clear cache system on a static class, make RegionNameMapper a class that gets instantiated for use and let the ctor handle it. * Remove debugging * Update tests to actually test things --------- Co-authored-by: Pradeep Chellappan <Pradeep.Chellappan@docusign.com> Co-authored-by: Pradeep Chellappan <94089783+pradeep-chellappan@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

* Fix traceid null exception issue * Fixing merge conflicts * Fixing merge conflicts * Update script * Code cleanup * Updated change description * updated comment description * updated comment description --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* GA telemetry options and updated contract * enabe requuest level option * added request option in public contract

* direct version bump * Code changes to fix emulator tests to comply with direct release 3.31.5. --------- Co-authored-by: Debdatta Kunda <dkunda@microsoft.com>

* Update ServerSidePartitionedMetrics.cs * Update ServerSidePartitionedMetrics.cs

* Added Upsert Trigger Operation Support * updated contract * fix test

* first draft * updated changelog * remove already released PRs * updated pr links * changelog and contract changes * updated changelog * updated changelog * updated changelog * remove 4071 from changelog as it should be internal PR * removed an query internal log * updated contracts

…4130) * remove release variable * revert build config variable change also

…Handling = Error on Json default settings when NotFound on Item operations. (#4125) * issue 4115 initial checkin. need insight from issuer on reproducing this issue * test refactoring and adding more coverage for other NotFound scenarios * commit on some actionables * setting JsonConvert.DefaultSettings to null so that other tests will not fail * as requested, removed catches from test methods

* initial cleanup * test updates - working * cleanup * more cleanup * more * whoops * Add results to basline * adding payload to xml * some generics * cleanup * Add datamember serializer * reorder functions and test fix * tostring() update and add case * fix payload * fix datamembertest * cleanup * cleanup * PR comment --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Client Telemetry Release test fix * get endpoint from env variable * read client telemetry endpoint service from env * updated yaml

…#4150) * Fixed client cpnfig test and preview pipeline * fix telemertry service step

* Initial commit * Update * Updated the test * Updated the test * Sample fix; to validate Suite0. * Skipped the ConflictsTest (which depends on azure cosmosdb account) * Addressed comments * Added Unit Test. * Reverted unnecessary change.

…on (#4136) Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.5.0 to 1.10.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.5.0...Azure.Identity_1.10.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.5.0 to 1.10.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.5.0...Azure.Identity_1.10.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…4073) * Code changes to add retry logic for GW returned 503.9002. * Revert "Code changes to add retry logic for GW returned 503.9002." This reverts commit 53ef5f3. * Code changes to clean up the PPAF retry logic fix. * Code changes to add retry logic for GW returned 503.9002. * Revert "Code changes to add retry logic for GW returned 503.9002." This reverts commit 53ef5f3. * Code changes to clean up the PPAF retry logic fix. * Code changes to revert location cache changes. * Code changes ro revert location cache changes. * Code changes to fix some of the failing tests. * Code changes to fix unit tests. * Code changes to add unit tests for client options. * Code changes to draft docs for PPAF design approach. * Code changes to add SDK side design docs for PPAF. * Code changes to modify the PPAF design. * Code changes to fix unit test. * Code changes to rename test name. * Code changes to add some cosmetic changes. * Code changes to enable retry on write for all regions in single master accounts. * Code changes to add code comments. * Code changes to clean up and handle endpoints in location cache. * Code changes to fix unit tests. Added detailed code comments. * Code changes to clean up the account read endpoints generation logic. * Code changes to fix unit tests. * Code changes to disable retry when ppaf is not enabled. Also validated application preferred region. * Code changes to fix unit tests. * Code changes to update md file. * Code changes to remove chache expiry check for account read endpoints. * Code changes to fix unit test. * Code changes to fix more tests. * Code changes to address review comments. * Code changes to fix verbaige in design document.

…ER BY queries (#4158) * Fix logic in CosmosQueryExecutionContextFactory where we determine optimal page size for ORDER BY queries that have an OFFSET/LIMIT clause. Previously, the logic was only being applied to TOP and not OFFSET/LIMIT. * Changes based on PR feedback * Change based on PR feedback

* add tests * fix tests * remove unreated files

* Bump Azure.Identity in /Microsoft.Azure.Cosmos.Encryption.Custom/src Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.1.1 to 1.10.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.1.1...Azure.Identity_1.10.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update Microsoft.Azure.Cosmos.Encryption.Custom.csproj Updated the Azure.Core version --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Santosh Kulkarni <66682828+kr-santosh@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Remove passThrough from the codebase * Updated TestOptimisticDirectExecutionQueryAsync() to remove all aspects of passThrough from it * Undoing previous change * Removed forcePassThrough from FullPipelineTests.cs * Undoing changes to remove PassThrough * Undoing passThrough removal pt2 * Undoing changes to SanityQueryTests.cs * Updated TestTryExecuteQueryHelper() * Updated comment * Changed boolean location * Removed TryExecuteQueryAsync() * Fixed indentation

…ion. (#4123) * Code changes to fix duplicate channel and thread pool on refresh flow. * Code changes to fix failed tests. * Code changes to add global semaphore for concurrency control in address cache. * Code changes to refactor the refresh async method. * Code changes to address review comments. * Code changes to update summary.

* add api * tests * Update test * Rename

…lizer (#4170) * Update Program.cs * Update Program.cs * Update Program.cs * Update Program.cs --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

) * intial commit * add interface * PR comments and TranslationContext cleanup * update params * fix parameters * PR comments * PR comments * PR comments * simplifying serializer class * interface updates * Update docs * PR comments * PR comments * PR comments - rename and fix assert

* adds excludeRegions * suggested changes * removed unused usings * fixed blank line error * removed using * update contracts * fixed test * reverted automatic changes to BaselineTests * requested changes * bug fix * PPOF test fix

…ature for Preview (#4180) * Code changes to enable replica validation for preview. * Code changes to enable replica validation for preview and GA.

…y mitigated it by changing the MAXDEPATH (#4185)

…Created vs Replaced (#4186) * Upset status codes clarification * Upgrade Resiliency: Adds Code to Enable Advanced Replica Selection Feature for Preview (#4180) * Code changes to enable replica validation for preview. * Code changes to enable replica validation for preview and GA. --------- Co-authored-by: Debdatta Kunda <87335885+kundadebdatta@users.noreply.github.com>

…ects (#4188) * [Internal] CodeAnalsis: Fixing CA2200 for test projects * Making code warning clean * fixing the usages projects * Removing the insource overrides * One mroe small fix --------- Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

* Updated change log and bumped up the patch version. * Updated change log and bumped up the minor version. * Updated change log to reflect correct version.

* Create versioning.md * Update versioning.md * Update versioning.md * Update versioning.md * Update README.md * Update versioning.md * Update versioning.md * Apply suggestions from code review Co-authored-by: Kevin Pilch <kevinpi@microsoft.com> * Update versioning.md * Update versioning.md --------- Co-authored-by: Kevin Pilch <kevinpi@microsoft.com>

…index advisor (#4176) * add baseline tests * added back missing bracket * update csporj file --------- Co-authored-by: Minh Le <leminh@microsoft.com>

* Removing * fix

… on the Client (#4122) * Added ability to accept the AllowOptimisticDirectExecution flag from the backend and use that flag to decide if the Ode pipeline should be used or not. * Added comment and removed extra spacing * Added test coverage * Added exception handling logic * Resolved comments * Added null check for key parameter * Removed changes to common test infra * Removed all changes from QueryPartitionProviderTestInstance * Remove changes pt2 * Removed the dictionary in QueryPartitionProvider and added a bool instead * Updated GetClientDisableOptimisticDirectExecution() * Fixed comments * Revert QueryIterator.cs * Undoing changes to settings.json * Undoing changes to QueryIterator.cs * Updated error message * Made functions static * Cast to bool instead of recasting in GetClientDisableOptimisticDirectExecution() * Added ignore flag * Fixed merge conflicts * Updated GetPartitionedQueryExecutionInfoAndPartitionProvider() * Updated return type in OffsetLimitPageSize()

…#4177) * Added ability to accept the AllowOptimisticDirectExecution flag from the backend and use that flag to decide if the Ode pipeline should be used or not. * Added comment and removed extra spacing * Added test coverage * Added exception handling logic * Resolved comments * Added null check for key parameter * Removed changes to common test infra * Removed all changes from QueryPartitionProviderTestInstance * Remove changes pt2 * Removed the dictionary in QueryPartitionProvider and added a bool instead * Updated GetClientDisableOptimisticDirectExecution() * Fixed comments * Revert QueryIterator.cs * Undoing changes to settings.json * Undoing changes to QueryIterator.cs * Updated error message * Made functions static * Cast to bool instead of recasting in GetClientDisableOptimisticDirectExecution() * Added clientQLCompatibilityLevel support on client * Updated assert * Updated client tests to use Data Contract serializer and deserializer * Added support to obtain the distribution plan payload on the client * Added binary support * Removed CheckCompatibilityLevelFlagInQuerySpec() * Renamed ParseElementsFromRestStream() * Updated test response * Switched to using binary json navigator * Using local variable before type check * Updated name to DistributionPlanSpec * Added support to test multiple distribution plan samples * Removed binary sample * Updated binary test * Added ignore flag * Fixed merge conflicts 2.0 * Resolved comments * Updated function name * Removed an unnecessary assert * Fixed comment * Improved debug assert message * Added checks to confirm that resourceType is document before getting distributionPlan * Removed changes to resourceManagement.yml

* update csproj * image * Right image * Sigh --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

) * Updated Cosmosd SDK version in Open telemetry and AppInsight Samples * clean up code * fixd samples * remove underscore from variable name

…on 3.35.4 (#4214) * changing version * changing version * changing version * new versioning --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

…ce (#4220) * Calling dispose * Tests * refactoring

…Retry Policy (#4205) * Code changes to retry on next preferred region for metadata reads on gateway timeouts. * Code changes to add retry for PK Ranges call. * Code changes to mark endpoint unavailable for read when cosmos exception occurs! * Code changes to fix unit tests. Added global endpoint manager in Pk Range Cache ctor. * Code changes to fix unit tests. * Code changes to fix build break. * Minor code clean-up. * Code changes to capture metadata location endpoint within on before send request. * Code changes to address review comments. * Code changes to fix build failure. * Code changes to refactor metadata timeout policy. * Code changes to add retry for request timeout. Fix emulator tests. * Code changes to add metadata retry policy unit tests. * Code changes to add more tests. * Code changes to refactor metadata retry policy logic to increment location index. Addressed review comments. * Code changes to address review comments. * Code changes to address review comments. * Code changes to add separate condition for pk range requests.

* memory leak fix * removed commented out code * changed to async so test would pass, with just static GetPropetiesHelper will get disposed before requests go through * added thread saftey * fixed to interlock pattern --------- Co-authored-by: Debdatta Kunda <87335885+kundadebdatta@users.noreply.github.com>

* [Internal] GlobalEndpointManager: Fixes Memory Leak (#4226) * memory leak fix * removed commented out code * changed to async so test would pass, with just static GetPropetiesHelper will get disposed before requests go through * added thread saftey * fixed to interlock pattern --------- Co-authored-by: Debdatta Kunda <87335885+kundadebdatta@users.noreply.github.com> * changelog + version bump * genAPI * remove code changes * removed nit --------- Co-authored-by: Debdatta Kunda <87335885+kundadebdatta@users.noreply.github.com>

* initial commit * add more tests * cleanup * camel case fix * fix precidence and add test * cleanup * cleanup * Implement serializers * clenaup and bugfix * cleanup constructors * fix baseline * updates * cleanup * removed requirement to decorate enums * nit PR comments * bug fix and api updates * Pr comments * remove datacontract and newtonsoft serializer types * Pr comments and adding tests * updates * Aggregate tests and new serializer member * More tests and cleanup * PR comments * PR comments * PR comments - internal options class * Update Program.cs * comment fixes * PR comments * Add preview flag * API changes * new serialization interface * Update API and serializer updates * API fix * cleanup * PR comments * update interface * fix * API * Update Microsoft.Azure.Cosmos/src/Serializer/ICosmosLinqSerializer.cs Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Some PR comments * adding sample code * Enum rename and interfact to abstract class * PR comments * PR comments * Remove CosmosLinqSerializerType * last one (hopefully) * Update Microsoft.Azure.Cosmos/src/Linq/TranslationContext.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/src/Linq/TranslationContext.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…h Response Headers (#4240) * Code changes to add partition key range id header to bulk and transactional responses. * Code changes to add pk range id check in emulator tests.

…P responses (#4229) * initial commit * add back a using to fix build * change exception message * check for json validity using parse * some refactoring and tests. I want to see if I can mine more tests later. * comment to rethink removing the media type check * more tests and refactoring. going to mine out more tests before I undraft it * moved string to top of class * more tests and some refactoring * simplified some more things in tests * removing this method * removed unnecessary usings * last refactoring to ignore dealing with Error.Message when empty * removed null check on 2 arguments because it was breaking other tests. I will maybe come back to it later. * && and > 0 in the conditional

…V3 SDK (#4217) * Adds fault injection support * chaos factory method * added null check * fixed null check * requested changes * removed resolveFaultInjectionEndpoints * added requested comments

…4171) * Creating pipelines from Client Distribution Plan * Added DistributionPlanWriter * Added support for CqlSelectEnumerable * Added support for CqlArrayIndexerScalarExpression * Added support for literals * Added ScalarAsEnumerableExpression support * Modified comma code * Updated UserDefined Deserialization * Updated implementation for Undefined Literal * Updated baseline tests * Adds missing baseline file * Modified baseline tests to only show the client distribution plan instead of the whole distribution plan * Updated RemoveWhitespace() * Updated RemoveWhitespace() in ClientDistributionPlanBaselineTests * Removed dependencies on Newtonsoft

) * Code changes to update documentation. * Code changes to add code comment for etag property. * Code changes to update API docs for ReadItemAsync(). * Code changes to address minor doc correction. * Code changes to update remarks for patch item async.

* initial commit * moar tests * test fix * more test

* initial commit * Initial commit * Revert "initial commit" This reverts commit 8393599. * contract updates * support gateway * PR comments * add totalrequestcharge * API update * new trace class * Class cleanup * Move request charge to serversidemetrics - optional * Revert "Move request charge to serversidemetrics - optional" This reverts commit 2999084. * nit fixes

* Adding permissions to workflow * changing permissions * Lowering permissions * It was read * Nope it was write

…lt on .NET SDK (#4225) * Turned on ODe by default * update subpartitioning tests to include ODE * Updated contracts * adds multihash test cases * Updated client serialization test output * Updated OffsetLimitPageSize() test * Revert changes to Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.Tests/BaselineTest/TestBaseline/PartitionKeyHashBaselineTest.Lists.xml * Updated EndToEndTraceWriterBaselineTests.ReadManyAsync baseline test * Removed account details * Updated performance benchmark results * Set enableODE to true for some of the tests * Updated Feed token tests to test ODE and non ODE cases * Added ODE testing for Session token regression test * Updated AggregateQueryTests() and CosmosMultiHashTest() * Reverted changes to OffsetLimitPageSize() * Added ODE testing to AggregateFunctionAsync() * Removed account details from baseline tests * Added assert to confirm that the right document is being returned every time * Updated location of foreach loop for ODE * Updated baselines * Fixed comments * Cleaned up code * Fixed baselines * Updated more baselines * Setting QueryRequestRateTest() to not use ODE --------- Co-authored-by: Nalu Tripician <27316859+NaluTripician@users.noreply.github.com>

…heck (#4251) * first drfat * add test * add test * add documentation * builder changes * updating contract file * add tests * fix tests * remove builder method * updated contract * update gttpclient * cleanup * added validation nd doc * added validation * modified error message * Update Microsoft.Azure.Cosmos/src/CosmosClient.cs Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> * Update Microsoft.Azure.Cosmos/src/CosmosClientOptions.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * remove validation * updated client options * remving test * rename flag to DisableServerCertificateValidation * updated docs * updated test * updated doc --------- Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…esh; Marks Failing Encryption Test as Ignore (#4271) * Changed return pipeline type to ODE * Fixed following query team owned tests: IndexUtilizationHeaderLengthTest IndexUtilizationParse Fixed following SDK team owned test (based on guidance from Philip): ChangeFeedIteratorCore_WithFullFidelityReadFromBeginning Not able to repro failure for following test (all 3 instances pass locally): EncryptionChangeFeedDecryptionSuccessful * Marks following encryption test as ignored since it's flaky per offline discussion: EncryptionChangeFeedDecryptionSuccessful * Added fix for following test: TestQueryPlanGatewayAndServiceInteropAsync * Removed unused usings. --------- Co-authored-by: REDMOND\adityasa <adityasa@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…incorrect return type (#4221) * Primary Code Change * Added test coverage * addressed code review * address code review * add baseline capabilitiesadd baselines --------- Co-authored-by: Minh Le <leminh@microsoft.com>

…for Renewer (#4276) * Logging * tests

…ault (#4183) * add baseline tests * added back missing bracket * Enable text response for index advisor * update csproj * address code review * update tests --------- Co-authored-by: Minh Le <leminh@microsoft.com>

…r Public Usage. (#4279) * Code changes to add spain and mexico central regions for public usage. * Code changes to revert isreal central region. * Code changes to add isreal central region in API contract. * Code changes to fix test failures. --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…eValidation and ServerCertificateCustomValidationCallback are set together (#4283) * Added validation to check HttpFactory and ServerCallback are set together * fix validation

* Initial commit * Fixed failing aggregate tests. * Added validation for unsupported overloads of FirstOrDefault. * Addressed a couple of TODOs. * Addressed comments. * Addressed comments. * Addressed remaining comment.

…n response (#4291) * Update csproj * Applying suggestion from comment --------- Co-authored-by: Jake Willey <jawilley@microsoft.com>

) * Added PriorityLevel in CosmosClientoptions * Addressed comments on PR * Changed remark to remarks * Corrected null check * Updated contracts * reverted changes to PartitionKeyHashBaselineTest.Lists.xml * Update Microsoft.Azure.Cosmos/src/Handler/RequestInvokerHandler.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/src/Handler/RequestInvokerHandler.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Making priority level as GA contract * fixing the preview contract API * resetting few misc files * Builder and contract changes: --------- Co-authored-by: Achint Agrawal <acagrawal@microsoft.com> Co-authored-by: Debdatta Kunda <87335885+kundadebdatta@users.noreply.github.com> Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…Getting Thrown (#4241) * Code changes to add continuation token for account properties task. * Code changes to fix unobserved exception from getting thrown. * Code changes to sync up with master and remvoe unnecessary changes.

* Updated change log and bumped up the minor version. * Code changes to add few more required commits. * Code changes to pick new commits. * Code changes to address review comments. * Code changes to address more review comments. * Refactored the Warning section for better visibility. * Removed some of the unnecessary items.

…misticDirectExecution default (#4299) * Configured default value for EnableOptimisticDirectExecution setting to honor environment variable. * Updated tests to include case insensitive checks no environment variable name. * Addressed comments. * Removed unused using.

… DisableServerCertificateValidation (#4294) * DisableServerCertificateValidation: Fix ensuring that both HttpClient and DocumentClient use a consistency way * E2E Emulator test coverage * - Supporting the combination of both DisableServerCertificateValidation and ServerCertificateCustomValidationCallback combination - Supporting test hook for DisableServerCertificateValidationInvocationCallback (specifically for only Disable checking) * Addressing comments * Fixing a warning * Update Microsoft.Azure.Cosmos/src/CosmosClientOptions.cs Co-authored-by: Fabian Meiswinkel <fabian@meiswinkel.com> * Update Microsoft.Azure.Cosmos/src/CosmosClientOptions.cs Co-authored-by: Fabian Meiswinkel <fabian@meiswinkel.com> * Addressing commens * Undoing a change * Fixing UT * Renaming a test case name --------- Co-authored-by: Fabian Meiswinkel <fabian@meiswinkel.com>

… Serializer (#4306) * Initial commit * Revert "Initial commit" This reverts commit f826457. * sample custom serializer update * update docs

…ith 3.32.1 of direct package (#4282) * upgrade direct package to 3.32.1 * degrade core and add doagnosticspource 6.0.1 * updated otel contract * update otel factory * update contract * fix test * fixed tests * fixed tests * fixed tests * fixed source name and operation name in tests * fix tests * changed add tag fucn for integer fields * updated tests * unmask status code and substatuscode * updated contracts * fix query contract * update contracts after ordered operation activity * removed optional attributes * fix versioning * remove exception creation on request fail * changed message --------- Co-authored-by: Nalu Tripician <27316859+NaluTripician@users.noreply.github.com>

…4264) * porting Ian changes to new branch * changing DynamicTests back to its original state. Create a new test class for AllVersionsAndDeletes * including tests for AllVersionsAndDeletes DynamicTests * get master version of DynamicTests * testing changefeedprocessor with allversionsanddeletes * tests for changefeedprocessor with allversionsanddeletes * need to change name here also * adding example documentation to the GetChangeFeedProcessorBuilderWithAllVersionsAndDeletes * removed a line from example that was not necessary * removed ChangeFeedMode from Create signature and using what is in ChangeFeedProcessorOptions * undoing file * default to LatestVersion, not Incremental * change Incremental to LatestVersion on tests * change access modifier and remove PREVIEW gate for internal classes * more removal of unnecessary mode on Create for PartitionController and PartitionSupervisor * change access modifiers and moving methods around due to PREVIEW * adding GetChangeFeedProcessorBuilderWithAllVersionsAndDeletes to EncryptionContainer since it inherits Container * running UpdateContract powershell * override instead of abstract * fixing override, but not sure about how this works * taking guessing on this * lets try this again * once more * once more * internal on new change feed builder * making it public to test * internalizing the GetChangeFeedProcessorBuilderWithAllVersionsAndDeletes * removed DecryptChangeFeedDocumentAsync * undoing this file * removing commented code * moved to ContainerCore.Items.cs * removing and undoing some files created or updated by UpdateContracts.ps1 * removed space and undoing a file

* Code changes to bump up release versions. * Updated changelog. --------- Co-authored-by: REDMOND\adityasa <adityasa@microsoft.com>

* Init commit * address code review * address code review part 2 * fix formating --------- Co-authored-by: Minh Le <leminh@microsoft.com>

* initial commit * add files * restructure + some cleanup * fixed await for chaos interceptor creation * added default operation/conntection type values * threshold to thresholdpercentage * more threshold changes * changed application to rule application for clarity * changed method names in application context * spelling fix * addressed comments * tests/csproj fixes * requested changes * requested changes * added comments arrount duration * added comments arrount duration * application context changes to avoid bounded staleness problem * requested changes and test fixes * removed unused code * update contracts * Revert "update contracts" This reverts commit 8df3317.

* Code changes to add regional endpoints for account metadata calls. * Code changes to refactor some codes. * Code changes to add unit tests. * Code changes to make minor code clean-up. * Code changes to fix tests. Refactored API. * Code changes to refactor the enumeration logic inside global endpoint manager. * Code changes to address review comments. * Code changes to fix minor API parameter. * Code changes to update the API naming. * Code changes to update some attribute names. * Code changes to refactor service endpoint creation logic. * Code changes to address review comments. * Code changes to address review comments. * Code changes to update the API contract. * Cosmetic code changes. * Code changes to address review comments.

… to server.address (#4316) * Marking Distributed tracing feature as stable and changed an attribute name * remove it from emulator test * marked stable as false * fix tests * updated changefeedxml * remove statuscode and subsstatus from staic list * regenerated xml files * remove event counters events

…3774) * initial change to support sending continuation as resume value in query spec * serialize resume value in continuation token. * fix unit test that was failing. other minor refactors * additional refactoring update exception messages * few minor changes * additional tests * code refactoring * Create separate top level object to represent SqlQueryResumeValue. Different types of resume values are private in this object Consolidate all the visitor and serialization of resume value to SqlQueryResumeValue Other code review comments * handle different continuation token for target partition * update test for continuation from array and object values. other minor code refactors * save resume value as CosmosElement instead of defining a separate derived objects. update cosmosundefinedquerytests. other code review comments. * support on CosmosNumber64. Other number types are not supported for resume value. unit tests for SqlQueryResumeValue. * update cosmosundefinedquerytests to include arrays and object in order by and group by tests. reducing the document count to reduce execution time. * revert change to have separate SqlQueryResumeValue objects as it is better symmetry for comparing arrays and objects. * group resume value into 3 types: Undefined, Primitive and Complex * minor fix --------- Co-authored-by: Bala Perumalswamy <balaperu@ntdev.microsoft.com> Co-authored-by: Aditya <adityasa@users.noreply.github.com>

* Remove all code related to throwing an exception from client telemetry module * Update Microsoft.Azure.Cosmos/src/Telemetry/ClientTelemetryProcessor.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/src/Telemetry/ClientTelemetryProcessor.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * updated tests * remove extra try catch * updated message * cosmetic changes --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ses (#4338) * disable network level tracing in sdk * Revert "disable network level tracing in sdk" This reverts commit 627cba6. * Including Client Configuration in request Diagnostics for Sync calls also

…ing in sdk permanently (#4333) * disable network level tracing in sdk * update sample * remove network level tracing logic altogrther * 'fix spelling

…tedLag to 1 When CFP is Dormant after a Partition Split (#4324) * adding a test to repro issue 4285 * fix plus e2e test * not all request have cosmos exception * add a quick unit test for ChangeFeedEstimatorIterator when Gone exception happens * added a test description * ignoring long running test. meant to be ran manually * move long running tests to its own folder and category; check response and header for status/substatus * one test category only, removed using, and exluding LongRunning category from build pipeline * Update templates/build-test.yml I am committing your suggestion. Also, the goal of this PR is not to executed long running tests. I will create a new PR for this. Because there are other unknowns that I need to answer. So for now, I just don't want it to be executed with the existing pipelines. Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * change name of connectionString ENV to something more intention revealing --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

Fix spelling

#4301) * added yml files * added TestCategory param * fixed pipeline yml files * Update templates/build-test.yml Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * suggested changes --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

… in code doc (#4357) * Distributed Tracing Dcoumentation : Changed the default value mentioned in comment * Update Microsoft.Azure.Cosmos/src/CosmosThresholdOptions.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/src/CosmosThresholdOptions.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ow an exception. (#4334) * test to prove no exception, no documents when change feed more is changed. * renaming * throwing exception when changeFeedMode change on CFP with same lease container * removed PREVIEW tags under advisement. Well create a PR later * removed usings * revert to old summary * defaulting change feed mode to latestversion * change feed mode exception on switching and tests based on last recommendation. * more changes based on discussions * some refactoring * fixed some tests * more changes based on recommendations * another refactor * change from CosmosException to ArgumentException * removed CosmosException from comments * fixin tests to account for extra GetAllLeasesAsync call * some recommendation changes

…ariable (#4363) * Fixes Multi-Region CI pipeline to include env variable * fixed space * added validation test * string conversion * temp * temp2 * Update Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.EmulatorTests/ClientTests.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * Update Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.EmulatorTests/ClientTests.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * changed env location * temp * test * space * remove env * possible fix * test fix * clean up * changed enviroment variable get * test * test fix * ensure multiregion tests do not run with regular emulator tests --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…Processor (#4370) * preview cfp ffcf * ran updatecontracts * including this in Encryption * fixing name onChangesDelegate * sdkproject on encryptioncontainer * try this again * try, try, try again * with impl

Co-authored-by: Jiajun Peng <jiajunpeng@microsoft.com>

* refactoring for name change * more refactoring and run UpdateContracts

* Initial prep for adding a non streaming order by query pipline stage * Change TracingAsyncEnumerator to be an adapter class between ITracingAsyncEnumerator and IAsyncEnumerator * Move TracingAsyncEnumerator to product code * Change ITracingAsyncEnumerator.MoveNext to take a CancellationToken, thereby removing the awkward method SetCancellationToken from IQueryPipelineStage * draft implementation of non streaming order by pipeline stage * Fix bug that drops first record on an initialized page * Add a test class for non streaming order by unit tests * remove unnecessary usings * Add an emulator test for non streaming order by. Also lay groundwork for an alternative implementation for non streaming order by * Remove the ResponseLengthInBytes property from QueryPage. This was being calculated incorrectly, and seems to be unused to boot. * Add an ItemCount property to the Page class * Add a multi level heap implementation for non streaming order by * Add infrastructure for writing parity tests * Fix a bug that caused the page enumerator to be dropped when we reach flat heap sizze limit * When cloning OrderByQueryPartitionRangePageAsyncEnumerator as a fully buffered enumerator, make sure that we set the page size to maximum for the backend requests * Simplify the non streaming pipeline stage, and add performance test * Revert the changes for Headers.ItemCount Keep it as a string * Avoid an allocation each time the OrderByItems property of OrderByQueryResult is touched * Fix up the OrderByPipelineSatgeBenchmark to use fully materialized CosmosElements in the oages returned from MockContainer * Add a few more unit tests for non streaming order by * Add emulator tests for non streaming order by * Add a few more integration test cases * Fix up broken unit test * Add more test coverage for the non streaming order by * If there is no continuationtoken, assume that the response is streaming * Add stronger validation to the non streaming order by unit tests * Fix up broken unit tests to account for ItemCount * fix up plumbing for index utilization, and incorporate code review feedback * Minor clean up * revert bug introduced in pursuit of more elegant code :) * fix up broken unit test * Fix up broken perf test * Fix up broken IndexMetricsParserBaselineTest * Minor bug fixes for OrderByCrossPartitionEnumerator

…OUP BY LINQ queries (#4074) * preliminary change * Add some more boiler plate code * move all linq test to the same folder; add some groupBy test * fix references error in test refactoring add code for group by substitution. Still need to adjust binding post groupby * preliminary for the groupby functions with key and value selector * trying to change collection inputs for group by * WIP bookmark * Successfully ignore "key" * clean up code * Sucessfully bind the case of group by with only key selector and no value selector followed by an optional select clause * enable one group by test * add support for aggregate value selector * added baseline * working on adding support for multivalue value selector and key selector * code clean up * more clean up * more clean up * update test * Move test to separate file * code clean up * remove baseline file that got moved * fix merge issue * Changes test infrastructure to reflect changes from Master * address code review part 1 * Address code review 2 and adds code coverage * Addressed code review and added tests. Still a couple of bugs to iron out * Fix group by translation issue and add more test * update comments * address pr comment --------- Co-authored-by: Minh Le <leminh@microsoft.com> Co-authored-by: Aditya <adityasa@users.noreply.github.com>

* sketch out improved ParallelPrefetcher; focus is on reducing allocations, but we also can't be substantially slower to start all tasks * little more cleanup to further reduce allocations, and save a tiny amount of CPU * start on testing * some tweaks and testing for buffer management * test exception handling; fix a bug in high concurrency case that would swallow exceptions * test cancellation * more testing, a little bit of cleanup * test the case where the enumerator faults; fixes a couple leaks of Tasks and buffers that could occur in that some places * tiny bit of cleanup * cleanup and expand comments; code is tricky, it needs documentation * address a whole bunch of style nits, just to keep compiler Message counts down * address some feedback on comment clarity * don't rely on finalizers for testing, it's too brittle; hold up was not allocating more in the non-test cases, but found a field to reuse; needs benchmarking * complete ITrace proxy for testing * style nits and a bit more commentary * explicit test for concurrent access to the inner IEnumerator * explicit test that IEnumerator is disposed * explicitly implement all ITrace members * address feedback: internal class members should be public or private * address feedback: break test-only bits of ParallelPrefetch out into a partial * address feedback: move const above type declarations * address feedback: naming nits * address feedback: use the existing NoOpTrace * address feedback: remove pointless using * update baseline trace text for QueryAsync test --------- Co-authored-by: neildsh <35383880+neildsh@users.noreply.github.com>

…partition key against a sub-partitioned container (#4359) * Initial commit * Suite0 fixes. * Updated Test.

…33.0 (#4353) * upgraded direct package version * added Taiwan regions * update contracts * fix contracts * fixed more contracts * contracts change * contract change remove * changed baseline files * added space * added region name check test for future verification * nits --------- Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

Co-authored-by: Taylor Hamilton <tahamilt@microsoft.com>

…tibilityLevel (#4387) * Initial commit * Added Test Coverage.

…licy (#4379) * Initial code changes to add vector embedding policy and index type in container. * Code changes to add container builder for vector index type. * Code changes to add and fix tests. * Revert back client create and initialize test. * Skipping some of the V2 tests for vector indexes. * Code changes to fix GA and preview contracts. * Code changes to address review comments part 1. * Removed unnecessary JSON argument for vector index. * Code changes to update contract changes. * Code changes to update preview contract changes in tests. * Code changes to address few review comments. * Code changes to add few more tests to validate serialization and deserialization. * Code changes to address some review comments for best practices. * Code changes to fix test failures.

…tor read operation (#4374) * Distributed Tracing: Update operation name for non-generic feed iterator read operation * Update tests --------- Co-authored-by: joegoldman2 <147369450+joegoldman@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* SDK 3.40.0-preview.0: Adds version bump and changelog. * SDK 3.40.0-preview.0: Adds version bump and changelog. * SDK 3.40.0-preview.0: Adds version bump and changelog. * change version for release; create diffs * added query PRs to changelog * add note for Rename refactoring of ChangeFeedItemChange<T> to changelog * removing 4281 since it was mislabeled. it should have been treated as Internal * grammar error * formatting * case change * Update changelog.md Co-authored-by: Justine Cocchi <jucocchi@microsoft.com> * removing 4317 from change log. should be internal * add new regions to changelog. also Direct Package version update * fixed linked to DP PR * more changes based on review --------- Co-authored-by: Justine Cocchi <jucocchi@microsoft.com>

…ines (#4398)

…latest sdk (#4397) * Fix response message not parsing the index advice as text in latest sdk * add test coverage * address code review --------- Co-authored-by: Minh Le (from Dev Box) <leminh@microsoft.com>

Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>

* Adds code to create activity even customer is not subscribed to the feature * Added documentation

…on (#4410) Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.10.2 to 1.11.0. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.10.2...Azure.Identity_1.11.0) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.10.2 to 1.11.0. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.10.2...Azure.Identity_1.11.0) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

Bumps [OpenTelemetry.Instrumentation.Http](https://github.com/open-telemetry/opentelemetry-dotnet) from 1.6.0-rc.1 to 1.8.1. - [Release notes](https://github.com/open-telemetry/opentelemetry-dotnet/releases) - [Commits](open-telemetry/opentelemetry-dotnet@1.6.0-rc.1...Instrumentation.Http-1.8.1) --- updated-dependencies: - dependency-name: OpenTelemetry.Instrumentation.Http dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…lures in creating the inner pipeline stage are bubbled up to the higher stages (#4419)

…re.Cosmos.Encryption.Custom (#4421) * Bump dependency * Bump Azure.Core

…ns (#4403) * init * Added tests --------- Co-authored-by: Minh Le (from Dev Box) <leminh@microsoft.com>

… lease incremental documents that do not have a Mode property (#4426) * fix for 4423 * fix comment * some recommendation changes

#4424) * Code changes to fix one of the GW cache flakey tests. * Code changes to fix some of the assertions. * Code changes to use IsCompletedSuccessfully.

* SDK 3.39.1/3.40.0-preview.1: Adds version bump and changelog. * Update changelog.md Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>

* Initial commit * Update --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* initial commit * bump sample version * update comments * sln file fix * update comment * Update Microsoft.Azure.Cosmos/src/Serializer/CosmosLinqSerializer.cs Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com> * remarks fix * xml fix --------- Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

#4445) * Update SdkDesign.md * Update SdkDesign.md

…add a new flag to QueryInfo that will be used by ServiceInterop to indicate non streaming order by queries (#4446)

…default (#4413) * Turn of ODE by default. * Updated tests * Update * Test fix * Added test for query resumption with ODE token with partition split container (failure case). * Update. * Update Benchmark * Addressed comments.

* Initial Commit * nits

…_streaming in the response (#4459)

* initial commit * fixed tests * nits * small fixes * fixed test

* adding opt-in flags * adding pipeline

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

…ptions (#4433) * Added Request charge and Payload size options to generate request diagnostics * Added default values * add exception handling for payload size * Added test * update contract file * added docs * add null check * added more docs * updated contract * changed event name * remove unused import

…5022024

Commits on May 26, 2023

Update README.md (#3875 )

URL typo.

NaluTripician authored May 26, 2023

Configuration menu

View commit details

Copy full SHA for 83bad12

Browse repository at this point

Copy the full SHA

83bad12 View commit details

Browse the repository at this point in the history

Commits on May 27, 2023

moved to new file (#3876 )

sourabh1007 authored May 27, 2023

Configuration menu

View commit details

Copy full SHA for c5ef47e

Browse repository at this point

Copy the full SHA

c5ef47e View commit details

Browse the repository at this point in the history

Commits on Sep 12, 2023

first draft (#4079 )

sourabh1007 authored Sep 12, 2023

Configuration menu

View commit details

Copy full SHA for be0c098

Browse repository at this point

Copy the full SHA

be0c098 View commit details

Browse the repository at this point in the history

Commits on Feb 23, 2024

initial commit (#4323 )

Maya-Painter authored Feb 23, 2024

Configuration menu

View commit details

Copy full SHA for bf0f629

Browse repository at this point

Copy the full SHA

bf0f629 View commit details

Browse the repository at this point in the history

Commits on Mar 17, 2024

added known issue (#4349 )

NaluTripician authored Mar 17, 2024

Configuration menu

View commit details

Copy full SHA for 652b99d

Browse repository at this point

Copy the full SHA

652b99d View commit details

Browse the repository at this point in the history

[Internal] Direct : Refactores msdata/direct branch #4465

[Internal] Direct : Refactores msdata/direct branch #4465

Commits on Apr 7, 2023

Commits on Apr 8, 2023

Commits on Apr 10, 2023

Commits on Apr 11, 2023

Commits on Apr 18, 2023

Commits on Apr 24, 2023

Commits on Apr 25, 2023

Commits on Apr 27, 2023

Commits on May 1, 2023

Commits on May 2, 2023

Commits on May 3, 2023

Commits on May 4, 2023

Commits on May 5, 2023

Commits on May 9, 2023

Commits on May 10, 2023

Commits on May 16, 2023

Commits on May 17, 2023

Commits on May 18, 2023

Commits on May 19, 2023

Commits on May 22, 2023

Commits on May 23, 2023

Commits on May 24, 2023

Commits on May 25, 2023

Commits on May 26, 2023

Commits on May 27, 2023

Commits on May 30, 2023

Commits on May 31, 2023

Commits on Jun 1, 2023

Commits on Jun 2, 2023

Commits on Jun 5, 2023

Commits on Jun 7, 2023

Commits on Jun 8, 2023

Commits on Jun 9, 2023

Commits on Jun 10, 2023

Commits on Jun 12, 2023

Commits on Jun 14, 2023

Commits on Jun 15, 2023

Commits on Jun 17, 2023

Commits on Jun 19, 2023

Commits on Jun 22, 2023

Commits on Jun 26, 2023

Commits on Jun 27, 2023

Commits on Jun 28, 2023

Commits on Jun 30, 2023

Commits on Jul 4, 2023

Commits on Jul 6, 2023

Commits on Jul 7, 2023

Commits on Jul 10, 2023

Commits on Jul 11, 2023

Commits on Jul 12, 2023

Commits on Jul 14, 2023

Commits on Jul 17, 2023

Commits on Jul 19, 2023

Commits on Jul 28, 2023

Commits on Aug 1, 2023

Commits on Aug 5, 2023

Commits on Aug 8, 2023

Commits on Aug 9, 2023

Commits on Aug 10, 2023

Commits on Aug 11, 2023

Commits on Aug 15, 2023

Commits on Aug 16, 2023

Commits on Aug 18, 2023

Commits on Aug 22, 2023

Commits on Aug 23, 2023

Commits on Aug 29, 2023

Commits on Aug 31, 2023

Commits on Sep 5, 2023

Commits on Sep 8, 2023

Commits on Sep 11, 2023

Commits on Sep 12, 2023

Commits on Sep 14, 2023

Commits on Sep 15, 2023

Commits on Sep 18, 2023

Commits on Sep 20, 2023

Commits on Sep 26, 2023

Commits on Sep 28, 2023

Commits on Oct 3, 2023