-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing data after using influx_tsm #5924
Comments
Hi @ignaskniz, I can't seem to reproduce this locally following the instructions listed for upgrading your database engine, found here. Reading your steps, it doesn't sound like you're starting up the new server binary and letting the write-ahead log (WAL) flush to the shards before running the conversion tool. Can you confirm for me that you are starting up the new server before running the conversion tool? If you are, and are still seeing some fields being dropped, I may need some more detailed steps to be able to reproduce what you're seeing. |
Hello @joelegasse, I experienced the same issue. Followed the steps linked by you and I am certain that the WAL had flushed everything. For coincidence, I was examining the converter code trying to find out what could have happened, when I found this issue. I think that I found the problem but I don't have a solution yet. I will try my best to explain below what I think is the problem. On the b1 engine, each "record" in the bolt series bucket have the following structure: The
I am still analysing what would be the best solution in this case, but thought about commenting here so someone with a better knowledge of the converter can take a look at it. |
@vladlopes Thank you for the extra information, it turns out I had the wrong config selected, and actually was testing with a |
Hey,
since the issue with some field values being set to 0 has been fixed in 0.10.2, I am trying to use influx_tsm to migrate data from b1 shards to tsm1 and am faced with a different issue:
Seems like only one field per point gets migrated. I am running Ubuntu.
Reproduced it by:
Installed InfluxDB version 0.9.6.1, set the storage engine to "b1" in influxdb.conf
inserted points with multiple fields:
Where server is a tag, and cpu and memory are fields
I then installed InfluxDB 0.10.2 dpkg -i influxdb_0.10.2-1_amd64.deb
and ran influx_tsm with the following output:
After the process I connected to the database and ran the command again:
as can be seen two of the points lost memory field, and one lost cpu.
Is there something I can do to avoid this happening?
The text was updated successfully, but these errors were encountered: