Skip to content

Parallelize file processing #71

Closed
Closed
@kissgyorgy

Description

@kissgyorgy

We want to run the processing in a multiprocessing.pool.Pool.

In order to simplify the implementation, and for measuring things, we would do this in 2 steps:

  1. We can run unblob in for every new process_file call.
  2. We can look into yara.match callbacks and start the handling in the pool right away. (For the current code, this would need more complex changes.)

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestperformanceperformance improvements tasks

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions