Titles of Redirect Entries do not Show Up in Search Results

[gremid]

Describe the bug
When searching for titles, titles of redirect entries do not appear in the results. In the case of the DWDS custom app, we have about 16,000 redirect entries for alternative spellings of dictionary entries (i. e. "Delphin" vs. "Delfin") and while the major spelling variant can be found in the title search (i. e. "Delfin"), the alternative spelling does not show up (i. e. "Delphin").

Expected behavior

Both types of ZIM entries, content as well as redirect entries, should be indexed and searchable.

Steps to reproduce the behavior:

1. Open the DWDS custom app.
2. Search for "Delphin" vs. "Delfin".

Environment

• Version of Kiwix Android : DWDS Custom App 2023-11-20 Build: 7233250
• Device : Redmi Note 0S
• OS version : Android 13 TP1A.220624.014

[kelson42]

@gremid Definitly agree. I will check on my side, we have here maybe a bug in Zimwriterfs. I will do the investigation.

[kelson42]

@gremid I confirm the problem, this is not a problem with Kiwix-Android. This is a general problem and I believe that indeed the redirects are not indexed in the ZIM. You confirm you created this ZIM with the latest zimwriterfs with the option --redirects?
@mgautierfr You confirm that zimwriterfs indexes the redirects properly in the Xapian Title index? If "yes", what goes wrong here?

Here is the entry in the ZIM:

path: wb/Delphin
* title:          Delphin
* idx:            30476
* type:           redirect
* redirect index: 30431

[kelson42]

@mgautierfr I guess the problem is that in zimwriterfs, ZimCreatorFS::add_redirectArticles_from_file() does not have any hint?! I "yes", can you please make a fix.

[gremid]

The latest ZIM dwds_de_dictionary_nopic_2023-11-20.zim is built with zimwriterfs of zim-tools 3.3.0 and libzim 9.0.0.

[kelson42]

Kamino closed and cloned this issue to openzim/zim-tools