Managing Segments files

Each partition has a current (read/write) segment, and zero or more immutable segments. Each segment is comprised of a log file and an index file.

If the index file is missing or is empty but shouldn’t be, Tank will retry to rebuild the index from the log file. In fact, if you change the indexing interval configuration, you can just remove all *.index files from the partition(s) you are interested in, and Tank will rebuild them on startup, this take considering the latest indexing interval options.

You can also use tank to verify segment log files, using:

$> tank verify DataFiles/topic/partition/*

This will scan all provided segment files(logs and indices), making sure they are valid. Note that if you try to verify the current segment files, it may fail because they maybe currently updated ; retry or stop tank and verify them.