Why am I getting such errors using MassTransit with SQSqueues: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException'?

[olga-shtykova]

Hi,
Could someone please explain the reason of such error? How to fix this?

MassTransit version that is used is 8.1.1
TargetFramework netstandard2.0 and .NET6.0

Here is an example of the exception from the log:

{
  "Depth": 0,
  "ClassName": "System.AggregateException",
  "Message": "ReceiveLock.Faulted threw an exception (The CancellationTokenSource has been disposed.) (Collection was modified; enumeration operation may not execute.)",
  "Source": "MassTransit",
  "StackTraceString": "   at MassTransit.Transports.ReceivePipeDispatcher.Dispatch(ReceiveContext context, ReceiveLockContext receiveLock) in /_/src/MassTransit/Transports/ReceivePipeDispatcher.cs:line 117\r\n   at MassTransit.Transports.ReceivePipeDispatcher.Dispatch(ReceiveContext context, ReceiveLockContext receiveLock) in /_/src/MassTransit/Transports/ReceivePipeDispatcher.cs:line 117\r\n   at MassTransit.AmazonSqsTransport.Middleware.AmazonSqsMessageReceiver.HandleMessage(Message message, ReceiveLockContext lockContext) in /_/src/Transports/MassTransit.AmazonSqsTransport/AmazonSqsTransport/Middleware/AmazonSqsMessageReceiver.cs:line 124",
  "RemoteStackTraceString": null,
  "RemoteStackIndex": 0,
  "HResult": -2146233088,
  "HelpURL": null
},
{
  "Depth": 1,
  "ClassName": "System.ObjectDisposedException",
  "Message": "The CancellationTokenSource has been disposed.",
  "Source": "System.Private.CoreLib",
  "StackTraceString": "   at System.Threading.CancellationTokenSource.Cancel()\r\n   at MassTransit.AmazonSqsTransport.AmazonSqsReceiveLockContext.Faulted(Exception exception) in /_/src/Transports/MassTransit.AmazonSqsTransport/AmazonSqsTransport/AmazonSqsReceiveLockContext.cs:line 57\r\n   at MassTransit.Transports.PendingReceiveLockContext.Execute(Func`2 action) in /_/src/MassTransit/Transports/PendingReceiveLockContext.cs:line 67\r\n   at MassTransit.Transports.PendingReceiveLockContext.Execute(Func`2 action) in /_/src/MassTransit/Transports/PendingReceiveLockContext.cs:line 79\r\n   at MassTransit.Transports.ReceivePipeDispatcher.Dispatch(ReceiveContext context, ReceiveLockContext receiveLock) in /_/src/MassTransit/Transports/ReceivePipeDispatcher.cs:line 117",
  "RemoteStackTraceString": null,
  "RemoteStackIndex": 0,
  "HResult": -2146232798,
  "HelpURL": null
}

[ashovlin]

Have you raised this over on the MassTransit repo? Looking at the stack trace for the exception, I'm mostly seeing their code, and not a clear stack trace for the AWS SDK.

We have seen some Collection was modified; enumeration operation may not execute. issues in the AWS SDK recently around:

• System.Net.Http.Headers.HttpHeaders.ReadStoreValues exception after .NET6 upgrade #1940 - .NET 6 with the HTTP headers collection
• HashSet duplicate key exception when setting up region endpoints #1939 - Around the SDK's handling of AWS endpoint data.
  • This has been fixed in subsequent versions, so if you can check what AWSSDK.Core version is being referenced and/or a fuller SDK stack trace may help rule this out.

[olga-shtykova]

Thank you for your answer and some ideas!
Yes, I did raise this issue on MassTransit repo but haven't got any answer yet. I'm using AWSSDK.Core 3.7.303.12 version so it's not related to the issue #1939. I wonder if upgrading to .NET 8 would help solving this issue.