plaso-20180524-amd64 missing dfvfs/lib/cpio.yaml

[johnmccash]

When running the new plaso-20180524-amd64 windows binary of log2timeline against an E01 image, I get the following errors:

log2timeline --workers 28 --status_view window plaso_dump image.E01
Checking availability and versions of dependencies.
[OPTIONAL] missing: lzma.
[OK]

Traceback (most recent call last):
File "tools\log2timeline.py", line 68, in
File "tools\log2timeline.py", line 54, in Main
File "plaso\cli\log2timeline_tool.py", line 368, in ExtractEventsFromSources
File "plaso\cli\storage_media_tool.py", line 1099, in ScanSource
File "site-packages\dfvfs\helpers\source_scanner.py", line 565, in Scan
File "site-packages\dfvfs\helpers\source_scanner.py", line 366, in _ScanNode
File "site-packages\dfvfs\resolver\resolver.py", line 55, in OpenFileEntry
File "site-packages\dfvfs\resolver\resolver.py", line 158, in OpenFileSystem
File "site-packages\dfvfs\resolver\resolver.py", line 35, in GetResolverHelper
File "C:\Projects\pyinstaller\PyInstaller\loader\pyimod03_importers.py", line 396, in load_module
File "site-packages\dfvfs\resolver_helpers_init.py", line 10, in
File "C:\Projects\pyinstaller\PyInstaller\loader\pyimod03_importers.py", line 396, in load_module
File "site-packages\dfvfs\resolver_helpers\cpio_resolver_helper.py", line 10, in
File "C:\Projects\pyinstaller\PyInstaller\loader\pyimod03_importers.py", line 396, in load_module
File "site-packages\dfvfs\vfs\cpio_file_system.py", line 6, in
File "C:\Projects\pyinstaller\PyInstaller\loader\pyimod03_importers.py", line 396, in load_module
File "site-packages\dfvfs\lib\cpio.py", line 43, in
File "site-packages\dfvfs\lib\cpio.py", line 52, in CPIOArchiveFile
IOError: [Errno 2] No such file or directory: u'D:\DOWNLO~1\PLASO-~1\dfvfs\lib\cpio.yaml'
[11652] Failed to execute script log2timeline

[Onager]

This looks like an issue with the new dtFabric support in dfvfs. @rgayon and @joachimmetz can you take a look at this please?

[joachimmetz]

Looks like the yaml files are not copied by Pyinstaller. I'll update the build script.

[joachimmetz]

@johnmccash a work around is to copy the dfvfs and dfwinreg yaml files into the corresponding subdirectories within the Pyinstaller packaged directory.

[joachimmetz]

https://codereview.appspot.com/343260043/

[joachimmetz]

yes see my previous comment for a patch

[joachimmetz]

Though this bug should not affect CentOS. @flyp3navy could you give more information about how you installed plaso.

[joachimmetz]

@flyp3navy this is a different issue

Unable to create struct object from data type definition with error: Struct() argument 1 must be string, not unicode

This looks like a version of the struct Python module that does not support a unicode argument.

What version of Python 2.7 do you run:

python -V

[joachimmetz]

Try:

python2.7 -V

[joachimmetz]

That is quite an old version. I've created: libyal/dtfabric#11

One way would be to upgrade your version of Python.

I can try to build in a backward compatibility work around, but I would need to figure out when the struct module changed its interface first.

[joachimmetz]

the latest if 2.7 version if you can but definitely anything later than 2.7.10 due to fixes for SSL/TSL issues

[johnmccash]

Joachim - Per your comment "@johnmccash a work around is to copy the dfvfs and dfwinreg yaml files into the corresponding subdirectories within the Pyinstaller packaged directory."

Where do I find those files to copy them?

[johnmccash]

Nevermind. Found them at https://raw.githubusercontent.com/log2timeline/dfwinreg/master/dfwinreg/dtfabric.yaml, https://raw.githubusercontent.com/log2timeline/dfvfs/master/dfvfs/lib/cpio.yaml, and https://raw.githubusercontent.com/log2timeline/dfvfs/master/dfvfs/lib/gzipfile.yaml

Interestingly, I never got an error about that first one being missing. Seems to be working now though. Thanks

[joachimmetz]

Closing issue. Scripts updated to fix next deployment.