Silently disappearing transaction in getSignaturesForAddress

[0xx400]

Problem

I made (~11.12.2021 00:00 utc) an RPC call to https://api.mainnet-beta.solana.com/
with this request

>>>>>>>>>>>>>>>>>>>>>>>>          
{                                                                                                                                            
  "jsonrpc": "2.0",                
  "id": 1,                         
  "method": "getSignaturesForAddress",
  "params": [                      
    "4oTMm362DRcoszgY3zzyL73iYmY9X3uAJ1LTGNyDWhma",
    {                              
      "before": "2qjPRgBmpSbSKgwEMJQckTkMzevcbSJR6mrGtTt6cwkXii1M2KqcpxfKG2FEhKEsn3Ni9nV1BWY7QSeZXkQBwGb6",
      "until": "45A8mc1DAfm7WFhpGbkiQwGYQdD7Ew8h64CXy2PQpZWm2vxg4xEDkRN5WQVUBK2cR6Y2S43otRM1Es7vVy665HWf",                                   
      "limit": 10                           
    }                               
  ]                                
}           

and got this aswer

{                                          
  "jsonrpc": "2.0",           
  "result": [                                                                                                                                
    {                            
      "blockTime": 1638970368,    
      "confirmationStatus": "finalized",
      "err": null,                
      "memo": null,                     
      "signature": "4K6yzrRtWQz3evtERcVQxLqPSeyd7wwirFBquAmLvAfcTrXypVhL69XouzdkmN4KnZxcgZ6mSEyk2wEkfKKLDaex",
      "slot": 110613511           
    },                                                                                                                                       
    {                             
      "blockTime": 1638970354,    
      "confirmationStatus": "finalized",             
      "err": null,                                                                                                                                                                                                                                                                        
      "memo": null,                     
      "signature": "3Ufo9aF9v9j3GAeZXVSgBaj721snvbdQi9PZhdFi5mUxNPcuxRz8zJji1U5omgwpqZMwfNaXogQoBmXbT8jYMGba",
      "slot": 110613484 
    },                                                                                                                                       
    {                  
      "blockTime": 1638970321,
      "confirmationStatus": "finalized",
      "err": null,
      "memo": null,                                
      "signature": "MyKvpvKUeMH7BhGkbueGLMoQijqxwJ2WPh16iZQtuig2DWPrYNYHKpNHpAGjh85E2nFT7cXGw4d8YFaxyEVfhmb",
      "slot": 110613431
    },
    {
      "blockTime": 1638970261,
      "confirmationStatus": "finalized",
      "err": null,
      "memo": null,
      "signature": "Fk2WT6vTafECC6eVX8sRjzLKdnTKcbr1VTWepJRJ5nZnFHKB66aMkhExzQcdStxMjow2n7eox15EQubNCgaMsUH",
      "slot": 110613299
    },
    {
      "blockTime": 1638970248,
      "confirmationStatus": "finalized",
      "err": null,
      "memo": null,
      "signature": "5ZjJdMFiDaTsaPLs5srAxX51gAayTwGGAdF4YwZd36yvMir1Vssjtf1txEfVVUVSpcZCPdYd9bZGQaSHFyaAj72s",
      "slot": 110613277
    }
  ],
  "id": 1
}

Now, I make the same query ( ~13.12.2021 19:00 utc) and got

>>>>>>>>>>>>>>>>>>>>>>>>                                                                                                                                                                                                                                                                  
{                                                                                                                                                                                                                                                                                         
  "jsonrpc": "2.0",                                                                                                                                                                                                                                                                       
  "id": 1,                                                                                                                                                                                                                                                                                
  "method": "getSignaturesForAddress",                                                                                                                                                                                                                                                    
  "params": [                                                                                                                                                                                                                                                                             
    "4oTMm362DRcoszgY3zzyL73iYmY9X3uAJ1LTGNyDWhma",                                                                                                                                                                                                                                       
    {                                                                                                                                        
      "before": "2qjPRgBmpSbSKgwEMJQckTkMzevcbSJR6mrGtTt6cwkXii1M2KqcpxfKG2FEhKEsn3Ni9nV1BWY7QSeZXkQBwGb6",                                  
      "until": "45A8mc1DAfm7WFhpGbkiQwGYQdD7Ew8h64CXy2PQpZWm2vxg4xEDkRN5WQVUBK2cR6Y2S43otRM1Es7vVy665HWf",                                   
      "limit": 10                   
    }                                                                                                                                        
  ]                                     
}                        

<<<<<<<<<<<<<<<<<<<<<<<<<<                                                                                                                                                                                                                                                                
{                                                                                                                                                                                                                                                                                         
  "jsonrpc": "2.0",                                                                                                                                                                                                                                                                       
  "result": [                                                                                                                                                                                                                                                                             
    {                                                                                                                                                                                                                                                                                     
      "blockTime": 1638970368,                                                                                                                                                                                                                                                            
      "confirmationStatus": "finalized",                                                                                                                                                                                                                                                  
      "err": null,                                                                                                                                                                                                                                                                        
      "memo": null,                                                                                                                                                                                                                                                                       
      "signature": "4K6yzrRtWQz3evtERcVQxLqPSeyd7wwirFBquAmLvAfcTrXypVhL69XouzdkmN4KnZxcgZ6mSEyk2wEkfKKLDaex",                                                                                                                                                                            
      "slot": 110613511                                                                                                                                                                                                                                                                   
    },                                                                                                                                                                                                                                                                                    
    {                                                                                                                                                                                                                                                                                     
      "blockTime": 1638970354,                                                                                                                                                                                                                                                            
      "confirmationStatus": "finalized",                                                                                                                                                                                                                                                  
      "err": null,                                                                                                                           
      "memo": null,                                                                                                                          
      "signature": "3Ufo9aF9v9j3GAeZXVSgBaj721snvbdQi9PZhdFi5mUxNPcuxRz8zJji1U5omgwpqZMwfNaXogQoBmXbT8jYMGba",                               
      "slot": 110613484             
    },                                                                                                                                       
    {                                   
      "blockTime": 1638970337,          
      "confirmationStatus": "finalized",   
      "err": null,                                                                                                                           
      "memo": null,                                                                                                                          
      "signature": "1334qasknNxBbw7xaFM4AChSgcQ5bxq16BJUvKT5v8nVjBKG9zLxKUu5LKKU3CLCXkpDhDjuwSr3f3MsG72nj7q",
      "slot": 110613458           
    },                                                                                                                                       
    {                                   
      "blockTime": 1638970331,          
      "confirmationStatus": "finalized",                                                                                                     
      "err": null,                                                                                                                           
      "memo": null,                                                                                                                          
      "signature": "5GQvQC6S1NbCuobzbxcmhz3NLkufs1hKLyyaJnsTYbhNqZ3j2ueD4ihu4Y7dW7jgxz6xzmRx3cjSHNyYucAAimLz",                               
      "slot": 110613451                                                                                                                                                                                                                                                                   
    },                                                                
    {                                                                                                                                                                                                                                                                                     
      "blockTime": 1638970321,                   
      "confirmationStatus": "finalized",                                                                                                     
      "err": null,                                                                                                                           
      "memo": null,                                                                                                                                                                                                                                                                       
      "signature": "MyKvpvKUeMH7BhGkbueGLMoQijqxwJ2WPh16iZQtuig2DWPrYNYHKpNHpAGjh85E2nFT7cXGw4d8YFaxyEVfhmb",                                                                                                                                                                             
      "slot": 110613431                
    },                                             
    {                                                                 
      "blockTime": 1638970261,                                                                                                               
      "confirmationStatus": "finalized",                                                                                                     
      "err": null,                                                                                                                           
      "memo": null,                                                                                                                          
      "signature": "Fk2WT6vTafECC6eVX8sRjzLKdnTKcbr1VTWepJRJ5nZnFHKB66aMkhExzQcdStxMjow2n7eox15EQubNCgaMsUH",
      "slot": 110613299            
    },                                  
    {                                   
      "blockTime": 1638970248,     
      "confirmationStatus": "finalized",                                                                                                     
      "err": null,                                                                                                                           
      "memo": null,                         
      "signature": "5ZjJdMFiDaTsaPLs5srAxX51gAayTwGGAdF4YwZd36yvMir1Vssjtf1txEfVVUVSpcZCPdYd9bZGQaSHFyaAj72s",
      "slot": 110613277            
    }                                   
  ],                                                                                                                                         
  "id": 1                                  
}   

There are 2 additional transactions, which was not included in first answer: 5GQvQC6S1NbCuobzbxcmhz3NLkufs1hKLyyaJnsTYbhNqZ3j2ueD4ihu4Y7dW7jgxz6xzmRx3cjSHNyYucAAimLz and 1334qasknNxBbw7xaFM4AChSgcQ5bxq16BJUvKT5v8nVjBKG9zLxKUu5LKKU3CLCXkpDhDjuwSr3f3MsG72nj7q. This query was reproducible several times with several servers, and the same answer I got in explorer.solana.com.

Is there any guarantee, that getSignaturesForAddress return continuos bunch of transaction? And it not - what is the proper way to check, that I got all transaction between "before" & "untill" ?

For spending transaction, I could check post-balance & pre-balance. but there are transactions, where post-balance & pre-balance are the same. So, these transactions could disappear silently

Proposed Solution

[Anubis012]

Hi,
i'm expierencing this issue as well on following request :
[ { "jsonrpc": "2.0", "id": 1, "method": "getSignaturesForAddress", "params": ["4WXfY5BekQV56x2hGUWwCKTMbAGEWHaqrkrPheR5XbRa",{"limit": 1000}] } ]

Solscan is giving me the extra transaction 4va1dhVRv9bUr4SqXCyBVGaZW9wDU1Qm1nb4Vo5Ye7mpKyGQVSWzdra8Ccqt5ZqLCnLSVxTCxr8aJN8kMLzgAdto

Othere solana explorers don't show this transaction, neither does my rpc.
Although when you search on this specific signature however you do find it on all rpc's.
Currently I'm expecting the perased json is having in an issue while solscan implemented code directly on the memcp and is parsing it afterwards.