Gallium Semester Tasks

[kundadebdatta]

This is a master task list of all the items identified as a part of the Gallium semester deliverables. The tasks are listed below:

List of the work-items.

• Speculative Retries #3782 Cross Region Hedging (Thompson Sampling for Speculative Retry). => @NaluTripician is currently working on this.

• Upgrade follow-ups:

  • Use ARM Templates for Benchmarking #3848 Cosmos benchmark as ARM template . => @M-Lipin, @tangerinous are currently working on this and @kundadebdatta providing support and guidance.
  • Request Timeout - Reduce Default Timeout to 5 Seconds #3895 => @kundadebdatta has completed this task.
  • Rntbd Connection - Health Check Improvements #3773 Connection Health gap's=> @kundadebdatta has completed this task.
  • Transportation Chaos Simulation - Fault Injection #3819 Transport chaos simulation. => @NaluTripician currently working on it.
  • Upgrade Resiliency - Return the Transport Addresses Health State from Address Cache #3872 => @kundadebdatta has completed this task.
  • [Cosmos Service Upgrade - .NET] Replica Validation - Improve Rntbd Open Connection Logic to Validate Open Channels with Maximum Permitted #3908 => @kundadebdatta is currently working on this.
  • [Cosmos Service Upgrade - .NET] Optimize cosmos v3 code to open Rntbd connections in parallel #3518 => @kundadebdatta is currently working on this.
  • [Cosmos Service Upgrade - .NET] Replica Validation - Expose Replica Validation Feature as a Public Contract #3922 => @kundadebdatta is currently working on this.
  • CancellationToken wiring gaps through into CreateAndInitialize  #3923 => @kundadebdatta is currently working on this.
  • [Cosmos Service Upgrade - .NET] Replica Validation - Fix Race Conditions Caused by Calling Dispose() too early #4013 => @kundadebdatta is currently working on this.
  • [Cosmos Service Upgrade - .NET] Replica Validation - Fix Duplicate TCP Connections Opening Caused by Concurrent Requests #4033 => @kundadebdatta is currently working on this.
  • Dynamic timeout's (At-least connection-timeout) => @NaluTripician to analyze and scope.
  • Pipelined requests (fail faster) => @NaluTripician to analyze and scope.
  • Code clean ups after the Upgrade work. => @kundadebdatta .

• Per Partition Automatic Failover:

  • [Internal] Researching capabilities to support PPAF for .NET, Java SDK and Compute Gateway #3499 . => @philipthomas-MSFT, @kundadebdatta to Analyzing this currency.
  • [Per Partition Automatic Failover] Validate the Current Logic of Per Partition Failover Working as Expected #3978 . => @kundadebdatta has completed this item and merged the fix.
  • [Per Partition Automatic Failover] Extend Automatic Failover For Single Master Write Requests  #3981 => @kundadebdatta has completed this item and merged the fix.
  • [Per Partition Automatic Failover] Utilize DnsClient to Read DNS TXT Records #3977 => @kundadebdatta to Analyze and Scope.
  • [Per Partition Automatic Failover] Retry on Next Preferred Region For Metadata Reads Gateway Timeouts #4181 => @kundadebdatta has completed this item and merged the fix.
  • [Per Partition Automatic Failover] Utilize CosmosClientOptions to Capture Custom Domain Names to resolve Cx Specified Endpoints  #4236 => @kundadebdatta is currently working on this.

• Supportability:

  • ClientTelemetry => Debdatta to analyze and scope. (Should be prioritized)
  • Diagnostics (any missing context) => Debdatta to analyze and scope.
  • Compaction => Backlog Item - Ways to reduce the diagnostics content.

• Reliable Writes:

  • Prioritize brute force logic. => Debdatta to Analyze and Scope.
  • Non-brute-force logic => Backlog

• Caches: Guaranteed address refreshes (decouple from CX CancellationToken's) => Nalu to Analyze and Pick Up.

• DNS -> IP handling (Caching etc.)

  • DNS outage, Compute corss-federtation routing etc. => Nalu to Experiment/ Analysis: Can we do DNS to IP mapping ourselves. (Last good known). Right now, waiting on clarifications.

Other Miscellaneous Tasks:

• Connection sharing between clients.
• Patch and Bulk in the same library.

[philipthomas-MSFT]

@kundadebdatta @kirankumarkolli Is this an official list and source of truth for Gallium semester?

[kundadebdatta]

@kundadebdatta @kirankumarkolli Is this an official list and source of truth for Gallium semester?

Hi @philipthomas-MSFT - Thanks! This is meant to list down the tasks that are assigned to @NaluTripician and Me for the Gallium semester scope.