-
Notifications
You must be signed in to change notification settings - Fork 95
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Frequent log messages to run list_symbols
on some of my libraries
#1845
Comments
list_symbols
on some of my libraries
Thanks for reporting this. The issue is, I think, explained by the We have a under-documented feature here, which is that you can use integers as symbol names, e.g.,
However, you can't currently mix these with string symbol names as you'll get this issue. If that is the problem here, then the work-around is to
|
I terms of fixing this issue, I think there are two options. Either
or,
|
Thank you @jamesmunro, I will try out your suggested work-around |
I've tested the issue a bit wider, and with the
|
lib Calling this: In my AWS S3 Console I went through all my symbols and I could not find any int or float as symbol names, however I have many names that are like But they are all strings. Though I did not explicitly called Could maybe this caused the issue? |
Hi @philsv. That error suggests a different issues. It is not recognizing the object in S3 as an ArcticDB object, the As a work around, I think at this point it's easiest to remake the library. If you would like us to help you more with this issue then can you please send us a list of objects in the library? Find the full storage name of the library:
then take the full library path printed and list all the items under
You can send the results to arcticdb@man.com. |
RE: If |
@jamesmunro I think what caused the error Just a moment ago I was recreating the library and this error poped up:
In terminal:
I think that might have been the issue. For all the other symbols in the library, no issues.
If you mean loading the data in batches. No I did not. But I very frequently (weekly, daily) update the datasets. |
These errors your getting are all pointing to either missing or malformed objects in the S3 bucket. I think we would need to understand your environment and setup better to get to the bottom of this.
You can also get a detailed log with |
Describe the bug
How can I get rid of this log messaging?
I already did what is suggested in the message running:
symbol_list = library.list_symbols()
on every read and write operation.
Also this log message did not appears once but on every read or write operation for me.
Is there some why to supress this log message?
Steps/Code to Reproduce
Expected Results
Unncessary log messaging
OS, Python Version and ArcticDB Version
Python: 3.11.0 | packaged by conda-forge | (main, Oct 25 2022, 06:12:32) [MSC v.1929 64 bit (AMD64)]
OS: Windows-10-10.0.22621-SP0
ArcticDB: 4.5.0
Backend storage used
AWS S3
Additional Context
No response
The text was updated successfully, but these errors were encountered: