Merge branch 'master' of github.com:sepinf-inc/IPED into minio_ufdr

ReleaseNotes.txt

@@ -1,12 +1,17 @@
-XX/XX/2024: IPED-4.2.0:
+30/12/2024: IPED-4.2.0:
 News:
 #39:   Filter Manager (@patrickdalla, @lfcnassif)
 #1823: New transcription implementation using Whisper (@lfcnassif, @gfd2020, @marcus6n) 
 #2118: New table column header filter like Excel (@patrickdalla, @lfcnassif, @wladimirleite)
 #1182: Translation to French (Didier Meziat-Burdin, Christopher Etienne, @jelallt, @lfcnassif)
+#1896: Parser for Threema Secure Messenger files (@costa-arc, @lfcnassif)
 #1969: Utility tool to scan a folder for cases and export files matching a search criteria (@lfcnassif)
-#2028: Support for UFDR generated by Physical Analyzer version 8+ (@marcosammoura)
+#2028: Better support for UFDR generated by Physical Analyzer version 8+ (@marcosammoura)
+#2262: Compatibility with PA 10: Attachment being considered file (@aberenguel)
+#2299: File referenced by "Local Path" not contained in UFDR file of PA 10 (@aberenguel)
+#2272: Support Location in UFDR from Physical Analyzer 10+ (@aberenguel, @lfcnassif)
 #693:  Show and jump to WhatsApp quoted messages in reply messages in WhatsApp preview (@gfd2020, @wladimirleite)
+#2245: Jump to WhatsApp quoted messages in reply edited messages (@gfd2020, @wladimirleite, @lfcnassif)
 #2030: Support WhatsApp "view once" messages (@wladimirleite)
 #1725: Add a notice about WhatsApp edited messages (@wladimirleite)
 #1923: Handle other WhatsApp Message Types (@wladimirleite)
@@ -15,12 +20,14 @@ News:
 #2044: Link modified WhatsApp images by long path (@wladimirleite)
 #1990: Update Telegram decoder plugin (@hauck-jvsh, @lfcnassif)
 #2184: Support new Telegram version for android (@hauck-jvsh, @lfcnassif)
+#2296: Support another new Telegram version for Android (@hauck-jvsh, @lfcnassif)
 #1998: Support some recent Telegram iOS chats not being parsed (@wladimirleite, @hauck-jvsh)
 #2005: Enable Telegram iOS parser for UFDR and expose "extractMessages" parameter for Telegram Parser (@wladimirleite)
 #2000: Better detection of Telegram iOS databases (@wladimirleite)
 #2134: Improve Telegram Channels support on Android (@wladimirleite, @lfcnassif)
 #1568: Google Chrome Cache Parser (@felipecampanini, @patrickdalla, @lfcnassif)
 #1985: Carver for .torrent files and resume.dat (@wladimirleite, @patrickdalla)
+#2234: Resume.dat entries carver and parser (@wladimirleite, @lfcnassif)
 #2185: Link case files to torrents and torrents to resume.dat (@wladimirleite, @patrickdalla, @lfcnassif)
 #1986: Parse more information from torrents (@wladimirleite, @patrickdalla)
 #2193: Better detection of Torrent client "settings.dat"
@@ -64,6 +71,13 @@ News:
 #2100: Make TempFileTask maximum file length configurable (@wladimirleite)
 #242:  Upgrade JS interpreter to support some ECMAScript 6 features (@lfcnassif)
 #1828: Move enableOCR to IPEDConfig.txt again (@lfcnassif)
+#1631: Menu option to check items and their related items (@aberenguel, @wladimirleite)
+#2335: Make sure audios are resampled to 16Khz before transcription (@hauck-jvsh, @lfcnassif)
+#2326: Support new version of WhatsApp Android database (no "raw_string_jid" column in "chart_view" view) (@wladimirleite)
+#2375: Handle other WhatsApp for iOS Message Types (@wladimirleite)
+#2371: Rename crypto-related regular expressions (@wladimirleite)
+#2294: Parse WhatsApp account info from more sources (@aberenguel, @wladimirleite)
+#1961: Upgrade Apache Commons Compress to 1.27.1 (@lfcnassif, @wladimirleite)
 Optimizations:
 #1224: Optimize processing UFDR evidences (@lfcnassif)
 #1958: Optimize processing small files (@lfcnassif)
@@ -76,9 +90,14 @@ Optimizations:
 #1598: Optimize memory usage by Timeline chart with very large cases (@patrickdalla, @lfcnassif)
 #1265: Optimize Graph CSV (un)compression again (@lfcnassif)
 #1965: Optimize Tika's SAXParser default pool size (@lfcnassif)
+#2011: Use group name as "Communication:To" in chat messages, instead of including each member (@lfcnassif)
 #1960: Minor memory optimization in WhatsApp and other parsers (@wladimirleite)
 #1652: Minor memory optimization in Timeline chart when creating time index (@patrickdalla)
+#1539: Speed up Whisper transcription inference (@hauck-jvsh)
+#2319: Speed up report generator with FaceRecognition (@aberenguel)
 #2014: Minor optimization in StandardParser when processing multi-valued metadata (@wladimirleite)
+#2344: Improve gallery rendering speed (@lfcnassif, @wladimirleite)
+#2346: Do not run again ImageSimilarityTask when generating a report (@wladimirleite)
 Fixes:
 #2035: Sometimes WhatsApp messages are out of order (@wladimirleite)
 #2203: Broken links in HTML report when "thumbs only" option is used (@wladimirleite)
@@ -90,6 +109,16 @@ Fixes:
 #2033: Aborting OutOfMemoryError caused by TwelveMonkeys TIF reader plugin (@wladimirleite)
 #1926: Map items checkboxes inconsistent selection (@patrickdalla)
 #2003: In rare cases, Telegram iOS DBs decoding may fail and cause exceptions (@wladimirleite)
+#2232: Displayed count of items per category is wrong for "Program and Libraries" if "Android Apps" has items (@wladimirleite)
+#2264: Go to parent file freezes UI when executed from UFDR imported replied instant messages (@lfcnassif)
+#2275: WhatsApp parser is showing swapped status of calls between "declined" and "missed" (@wladimirleite)
+#2282: Telegram Groups interpreted as Channels (@aberenguel)
+#2290: Inconsistent view of Viewers on Linux (@aberenguel, @wladimirleite)
+#2337: Error parsing WhatsApp DB (Comparison method violates its general contract) (@wladimirleite)
+#2357: Corrupted local java copy avoiding application to start (@wladimirleite)
+#2364: Torrent parser sometimes add "garbage hashes" to linkedItems (@wladimirleite)
+#2381: Error generating report if audio transcription is enable, but model or service not available (@wladimirleite)
+#2391: Repaint glitch in the gallery when managing bookmarks (@wladimirleite)
 
 
 05/04/2024: IPED-4.1.6:

iped-api/pom.xml

@@ -4,7 +4,7 @@
     <parent>
         <groupId>iped</groupId>
         <artifactId>iped-parent</artifactId>
-        <version>4.2-snapshot</version>
+        <version>4.2.0</version>
     </parent>
 
     <artifactId>iped-api</artifactId>

iped-app/pom.xml

@@ -4,7 +4,7 @@
 	<parent>
         <groupId>iped</groupId>
         <artifactId>iped-parent</artifactId>
-        <version>4.2-snapshot</version>
+        <version>4.2.0</version>
     </parent>
 
     <artifactId>iped-app</artifactId>

iped-app/resources/config/conf/AudioTranscriptConfig.txt

@@ -121,10 +121,10 @@ precision = int8
 batchSize = 1
 
 #########################################
-# RemoteAudioTranscriptTask options
+# RemoteTranscriptionTask options
 #########################################
 
-# IP:PORT of the service/central node used by the RemoteWav2Vec2TranscriptTask implementation.
+# IP:PORT of the service/central node used by the RemoteTranscriptionTask implementation.
 # remoteServiceAddress = 127.0.0.1:11111
 
 #########################################

iped-app/resources/config/conf/metadataTypes.txt

@@ -1662,9 +1662,9 @@ Regex:BR_CPF = java.lang.String
 Regex:BR_PISPASEP = java.lang.String
 Regex:BR_TITULO_ELEITOR = java.lang.String
 Regex:CREDIT_CARD = java.lang.String
-Regex:CRIPTOCOIN_BITCOIN_ADDRESS = java.lang.String
-Regex:CRIPTOCOIN_MONERO = java.lang.String
-Regex:CRIPTO_POSSIBLE_SEED_PHRASE_EN = java.lang.String
+Regex:CRYPTOCOIN_BITCOIN_ADDRESS = java.lang.String
+Regex:CRYPTOCOIN_MONERO = java.lang.String
+Regex:CRYPTO_POSSIBLE_SEED_PHRASE_EN = java.lang.String
 Regex:EMAIL = java.lang.String
 Regex:IP = java.lang.String
 Regex:MAC_ADDRESS = java.lang.String

iped-app/resources/localization/iped-categories_it_IT.properties

@@ -6,59 +6,59 @@ HTML\ Documents=Documenti\ HTML
 XML\ Files=File\ XML
 Georeferenced\ Files=File\ Georeferenziati
 Text\ Documents=Documenti\ di\ Testo
-Spreadsheets=Fogli\ di\ calcolo
+Spreadsheets=Fogli\ di\ Calcolo
 Presentations=Presentazioni
 OLE\ files=File\ OLE
 Links=Collegamenti
-Link\ files=Link\ file
+Link\ files=File\ di\ Collegamento
 URL\ links=Collegamenti\ URL
 Other\ Documents=Altri\ Documenti
-Emails\ and\ Mailboxes=E-mail\ e\ Caselle\ di\ Posta
-Emails=E-mail
+Emails\ and\ Mailboxes=Email\ e\ Caselle\ di\ Posta
+Emails=Email
 Mailboxes=Caselle\ di\ Posta
-Appointments=Appointments[TBT]
+Appointments=Appuntamenti
 GDrive\ Synced\ Files=GDrive\ (File\ sincronizzati)
 GDrive\ File\ Entries=GDrive\ (Registro\ File)
 Databases=Database
-Compressed\ Archives=Archivi\ compressi
+Compressed\ Archives=Archivi\ Compressi
 Contacts=Contatti
 Chats=Chat
 Others\ Chats=Altre\ Chat
-Windows\ Artifacts=Windows\ Artifacts
+Windows\ Artifacts=Artifact\ Windows
 Event\ Files=File\ Evento
-Event\ Records=Registro\ Eventi
+Event\ Records=Registri\ Evento
 Prefetch\ and\ Superfetch=Prefetch\ e\ Superfetch
-User\ Activities=Timeline\ Utente
-User\ Activities\ Entries=Timeline\ Eventi\ Utente
+User\ Activities=Attività\ Utente
+User\ Activities\ Entries=Voci\ Attività\ Utente
 Windows\ Registry=Registro\ di\ Windows
 Main\ Registry\ Files=File\ Registro\ Principale
 Other\ Registry\ Files=Altri\ File\ di\ Registro
-Registry\ Full\ Reports=Report\ Completi\ Registro
-Registry\ Custom\ Reports=Report\ Personalizzati\ Registro
-Registry\ OS\ Info=Informazioni\ Registro\ di\ Sistema
+Registry\ Full\ Reports=Rapporti\ Completi\ Registro
+Registry\ Custom\ Reports=Rapporti\ Personalizzati\ Registro
+Registry\ OS\ Info=Info\ Registro\ di\ Sistema
 Registry\ Installed\ Apps=Registro\ App\ Installate
-Registry\ Network\ Info=Informazioni\ sul\ Registro\ di\ Rete
-Registry\ Storage\ Info=Informazioni\ sul\ Registro\ di\ Archiviazione
-Registry\ Device\ Info=Informazioni\ sul\ Registro\ Dispositivi
+Registry\ Network\ Info=Info\ Registro\ di\ Rete
+Registry\ Storage\ Info=Info\ Registro\ di\ Archiviazione
+Registry\ Device\ Info=Info\ Registro\ Dispositivi
 Registry\ Program\ Run=Registro\ Avvio\ Programmi
 Registry\ Auto\ Run=Registro\ Avvio\ Automatico\ Programmi
-Registry\ Log\ Info=Informazioni\ Registro\ Log
-Registry\ Malware\ Info=Informazioni\ Registro\ Malware
-Registry\ Web\ Info=Informazioni\ Registro\ Web
-Registry\ User\ Info=Informazioni\ Registro\ Utente
+Registry\ Log\ Info=Info\ Registro\ Log
+Registry\ Malware\ Info=Info\ Registro\ Malware
+Registry\ Web\ Info=Info\ Registro\ Web
+Registry\ User\ Info=Info\ Registro\ Utente
 Registry\ User\ Accounts=Registro\ Account\ Utente
-Registry\ User\ Activity=Registro\ Attività\ Utente 
+Registry\ User\ Activity=Registro\ Attività\ Utente
 Registry\ User\ Files=Registro\ File\ Utente
 Registry\ User\ Network\ Activity=Registro\ Attività\ di\ Rete\ Utente
 Registry\ User\ Config=Registro\ Configurazione\ Utente
 Registry\ User\ Virtualization=Registro\ Virtualizzazione\ Utente
-Registry\ User\ Communication=Registro\ Comunicazioni\ Utente
+Registry\ User\ Communication=Registro\ Comunicazione\ Utente
 Windows\ Recycle=Cestino\ di\ Windows
-USN\ Journal=USN\ Journal
-Programs\ and\ Libraries=Software\ e\ Librerie
-Android\ Applications=Android\ Applications[TBT]
+USN\ Journal=Registro\ USN
+Programs\ and\ Libraries=Programmi\ e\ Librerie
+Android\ Applications=Applicazioni\ Android
 Unallocated=Spazio\ non\ allocato
-File\ Slacks=File\ Slack
+File\ Slacks=File\ Slacks
 Multimedia=Multimedia
 Audios=Audio
 Images=Immagini
@@ -78,42 +78,42 @@ Ares\ Galaxy=Ares\ Galaxy
 E-Mule=E-Mule
 Shareaza=Shareaza
 Torrent=Torrent
-Other Peer-to-peer=Altri Peer-to-peer
+Other\ Peer-to-peer=Altri Peer-to-peer
 Browser\ Artifacts=Tracce\ di\ navigazione
 Internet\ History=Cronologia\ Internet
-Internet\ History\ Entries=Registri\ Cronologia\ Internet
+Internet\ History\ Entries=Voci\ Cronologia\ Internet
 Web\ Bookmarks=Segnalibri\ Web
 Image\ Disks=Immagine\ Dischi
 ISO\ disks=Immagine\ ISO
 Virtual\ disks=Dischi\ Virtuali
-Other\ disks=Altri\ Dischi
-Mozilla\ Firefox\ Saved\ Session=Sessione\ Salvata\ Mozilla\ Firefox
+Other\ disks=Altri\ dischi
+Mozilla\ Firefox\ Saved\ Session=Sessione\ Salvata\ di\ Mozilla\ Firefox
 Folders=Cartelle
 Scanned\ Documents=Documenti\ scansionati
 Extraction\ Summary=Sommario\ estrazione
 Calls=Chiamate
-Discord\ Calls=Discord\ Calls[TBT]
-Facebook\ Calls=Facebook\ Calls[TBT]
-Other\ Calls=Other\ Calls[TBT]
-Phone\ Calls=Phone\ Calls[TBT]
-Signal\ Calls=Signal\ Calls[TBT]
-Telegram\ Calls=Telegram\ Calls[TBT]
-Threema\ Calls=Threema\ Calls[TBT]
-WhatsApp\ Calls=WhatsApp\ Calls[TBT]
+Discord\ Calls=Chiamate\ Discord
+Facebook\ Calls=Chiamate\ Facebook
+Other\ Calls=Altre\ Chiamate
+Phone\ Calls=Chiamate\ Telefoniche
+Signal\ Calls=Chiamate\ Signal
+Telegram\ Calls=Chiamate\ Telegram
+Threema\ Calls=Chiamate\ Threema
+WhatsApp\ Calls=Chiamate\ WhatsApp
 SMS\ Messages=Messaggi\ SMS
 MMS\ Messages=Messaggi\ MMS
-Instant\ Messages=Messaggi\ istantanei
+Instant\ Messages=Messaggi\ Istantanei
 Bluetooth\ Devices=Dispositivi\ Bluetooth
-SIM\ Data=Dati\ SIM 
+SIM\ Data=Dati\ SIM
 Calendar=Calendario
-Logs=Log
+Logs=Registri
 User\ Accounts=Account\ Utente
 Searches=Ricerche
 Notes=Note
 Wireless\ Networks=Reti\ Wireless
 Notifications=Notifiche
 Locations=Posizioni
-Cookies=Cookies
+Cookies=Cookie
 Configuration=Configurazione
 Passwords=Password
 Autofill=Compilazione\ automatica
@@ -123,22 +123,22 @@ User\ Dictionaries=Dizionari\ Utente
 IP\ Connections=Connessioni\ IP
 Recordings=Registrazioni
 Mobile\ Cards=SIM\ Mobili
-Applications\ Usage=Utilizzo\ Applicazione
+Applications\ Usage=Utilizzo\ Applicazioni
 Device\ Information=Informazioni\ Dispositivo
 iPhone\ Backup=Backup\ iPhone
 Torchat=TorChat
 Tor=Tor
-TorTCFragment=Frammenti di comunicazione Tor
-Cloud\ Drives=Drive\ Cloud
+TorTCFragment=Frammenti\ di\ Comunicazione\ Tor
+Cloud\ Drives=Unità\ Cloud
 Google\ Drive=Google\ Drive
 Telegram=Telegram
 Brazilian\ Software=Possibile\ software\ brasiliano
 Internal\ Revenue\ of\ Brazil=Agenzia\ delle\ Entrate\ Brasiliana
 Social\ Security\ and\ CAIXA\ Bank=Previdenza\ sociale\ e\ CAIXA
-Tax\ Returns\ and\ Receipts\ IRPF=Dichiarazioni\ e\ Ricevute\ IRPF
-Tax\ Returns\ and\ Receipts\ DIRF=Dichiarazioni\ e\ Ricevute\ DIRF
-Tax\ Returns\ and\ Receipts\ DIPJ=Dichiarazioni\ e\ Ricevute\ DIPJ
-Tax\ Returns\ and\ Receipts\ CNPJ=Dichiarazioni\ e\ Ricevute\ CNPJ
+Tax\ Returns\ and\ Receipts\ IRPF=Dichiarazioni\ Fiscali\ e\ Ricevute\ IRPF
+Tax\ Returns\ and\ Receipts\ DIRF=Dichiarazioni\ Fiscali\ e\ Ricevute\ DIRF
+Tax\ Returns\ and\ Receipts\ DIPJ=Dichiarazioni\ Fiscali\ e\ Ricevute\ DIPJ
+Tax\ Returns\ and\ Receipts\ CNPJ=Dichiarazioni\ Fiscali\ e\ Ricevute\ CNPJ
 Tax\ Returns\ and\ Receipts\ DSIMPLES=Dichiarazioni\ e\ Ricevute\ DSIMPLES
 Tax\ Returns\ and\ Receipts\ DCTF=Dichiarazioni\ e\ Ricevute\ DCTF
 Tax\ Returns\ and\ Receipts\ PER\ DCOMP=Dichiarazioni\ e\ Ricevute\ PER\ DCOMP
@@ -154,17 +154,17 @@ SEFIP\ Files=File\ SEFIP
 Social\ Connectivity\ Program\ Executables=Eseguibili\ Software\ Connettività\ Sociale
 Social\ Connectivity\ Program\ Files=Software\ Connettività\ Sociale
 GRRF\ Files=File\ GRRF
-Activities\ Sensor=Attività\ Sensore
-Chat\ Activities=Attività\ Chat
+Activities\ Sensor=Sensore\ di\ Attività
+Chat\ Activities=Attività\ di\ Chat
 Credit\ Cards=Carte\ di\ Credito
-Device\ Connectivity=Connectività\ Dispositivo
-Device\ Events=Eventi\ Dispositivo
-File\ Downloads=Download\ File
-File\ Uploads=File\ Uploads[TBT]
-Financial\ Accounts=Financial\ Accounts[TBT]
-Fuzzy\ Data=Fuzzy\ Data[TBT]
-Transfers\ of\ Funds=Transfers\ of\ Funds[TBT]
+Device\ Connectivity=Connettività\ del\ Dispositivo
+Device\ Events=Eventi\ del\ Dispositivo
+File\ Downloads=Download\ di\ File
+File\ Uploads=Upload\ di\ File
+Fuzzy\ Data=Dati\ Fuzzy
+Financial\ Accounts=Conti\ Finanziari
+Transfers\ of\ Funds=Trasferimenti\ di\ Fondi
 Journeys=Viaggi
-Networks\ Usage=Utilizzo\ Rete
+Networks\ Usage=Utilizzo\ delle\ Reti
 Recognized\ Devices=Dispositivi\ Riconosciuti
-Social\ Media\ Activities=Actività\ su\ Social\ Media
+Social\ Media\ Activities=Attività\ sui\ Social\ Media