Just first regex hit is shown if multiple regex patterns match the same input string

[lfcnassif]

Reported on #1745

[wladimirleite]

I can take a look at this, @lfcnassif.

[lfcnassif]

If you have available time @tc-wleite, that would be great! Thank you very much for all your volunteer work on this project!

[wladimirleite]

I was able to reproduce and fix the issue reported by @paulobreim (#1745 (comment)).
If a string matches more than one regex, only the first one was considered.

It doesn't seem to be the same situation reported by @milcent-CVM (#1745 (comment)).

@milcent-CVM, can you provide a couple of sample strings that should match the regex you created?

[milcent-CVM]

Sure! Thank you!

Let me just post the (still in evolution - regex101.com) Regex Pattern that got the most hits (still doesn't account for all latin characters in the person's name and expects case insensitive, which is the default in IPED):

\b(?:\n*)+(?:\s*\-?)?(?:[^\-]relatora?)+(?:\s*:?\s*)(?:diretora?|presidente|)?\s*(\w+é*(?:(?: +\w+)+))|(\w+(?:(?: +\w+é*)+))(?:\r*\t*\n*)(?:diretora?)\-(?:relatora?)\b

I will join here many parts of the articles in one peace that would result in many hits, OK?

"""
RELATOR :
WLADIMIR CASTELO BRANCO CASTRO

DURVAL JOSÉ SOLEDADE SANTOS
Diretor-Relator

JOSÉ LUIZ OSORIO DE ALMEIDA FILHO
RELATOR : Diretor Durval José Soledade Santos

Dos fatos
Lei nº 6.404/1976.

Diretor Relator: Alexandre Costa Rangel

Relatório de Julgamento (1251150) SEI 19957.010729/2019-31 / pg. 1

Data do julgamento: 23/06/2020

Relator: Diretor Henrique Machado

Acusados:

LEONARDO BRUNET MENDES DE MORAES

Diretor-Relator

FRANCISCO AUGUSTO DA COSTA E SILVA

Presidente

RELATÓRIO

Relator: Leonardo Brunet Mendes De Moraes

DOS FATOS

WLADIMIR CASTELO BRANCO CASTRO
Diretor-Relator

Presidente da Sessão

RELATÓRIO

Relator : Diretor Wladimir Castelo Branco Castro

Rio de Janeiro, 04 de abril de 2007.

Maria Helena de Santana
Diretora-Relatora

Marcelo Fernandez Trindade
Presidente da Sessão de Julgamento

Rio de Janeiro, 18 de dezembro de 2007.

Durval Soledade
Diretor-Relator

Maria Helena dos Santos Fernandes de Santana
Participaram do julgamento os Diretores Marcos Barbosa Pinto, Relator, Durval Soledade, Sergio Weguelin e a Presidente da CVM, Maria Helena dos Santos Fernandes de Santana.

Rio de Janeiro, 28 de agosto de 2007.

Marcos Barbosa Pinto
Diretor-Relator

Maria Helena dos Santos Fernandes de Santana
Rio de Janeiro, 21 de agosto de 2007.

Eli Loria
Diretor-Relator e Presidente da Sessão de Julgamento
"""

[wladimirleite]

@milcent-CVM, using the regex and the text posted, regex101 is not showing any matches (screenshot below).
Can you check if I am doing something different from what you are?

[milcent-CVM]

@tc-wleite , this is probably due to regex101 being case-sensitive, while IPED is not (at least according to RegexConfig.txt).
The Regex that works in regex101 is the one below:

\b(?:\n*)+(?:\s*\-?)?(?:[^\-]Relatora?|RELATORA?)+(?:\s*:?\s*)(?:Diretora?|DIRETORA?|Presidente|PRESIDENTE)?\s*(\w+(?:(?: +\w+é*É*)+))|(\w+(?:(?: +\w+é*É*)+))(?:\r*\t*\n*)(?:Diretora?|DIRETORA?)\-(?:Relatora?|RELATORA?)\b

[wladimirleite]

@milcent-CVM, it seems that syntax used by regex101 and IPED (which uses dk.brics.automaton) is not the same.
Please, take a look at:
https://www.brics.dk/automaton/faq.html
https://www.brics.dk/automaton/doc/dk/brics/automaton/RegExp.html

Trying simpler expressions first in IPED should help.
Or using a small standalone program to test the dk.brics.automaton library:

import dk.brics.automaton.*;
public class Test {
    public static void main(String[] args) {
        RegExp r = new RegExp("([^\\-]relatora?)");
        Automaton a = r.toAutomaton();
        String input = " relator".toLowerCase();
        System.out.println(a.run(input));
    }
}

This program output is "true".
But if I change the expression to "(?:[^\\-]relatora?)", it won't match.
However, in regex101, it does:

[milcent-CVM]

OK!! Thank you very much!! I will start with simpler patterns and work my way up, and try to find some testing framework more compatible with IPED’s Regex. Cheers! Marcel Milcent

…

________________________________ De: Luis Filipe Nassif ***@***.***> Enviado: Tuesday, September 26, 2023 11:25:55 PM Para: sepinf-inc/IPED ***@***.***> Cc: Marcel Tavares Quinteiro Milcent Assis ***@***.***>; Mention ***@***.***> Assunto: Re: [sepinf-inc/IPED] Custom user regex patterns in RegexConfig.txt could be ignored (Issue #1897) Closed #1897<#1897> as completed via #1900<#1900>. — Reply to this email directly, view it on GitHub<#1897 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ATVENE6ARPLVUG4WEI2XY73X4OFDHANCNFSM6AAAAAA5G7GH3A>. You are receiving this because you were mentioned.Message ID: ***@***.***>