Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document how to use primed profile #941

Open
vringar opened this issue Jun 28, 2021 · 5 comments
Open

Document how to use primed profile #941

vringar opened this issue Jun 28, 2021 · 5 comments
Labels
documentation task Doesn't change any behaviour

Comments

@vringar
Copy link
Contributor

vringar commented Jun 28, 2021

Currently there is no documentation on how to use primed profiles e.g. to run crawls with Addons or with some previous set of Cookies and Site Data.

@vringar vringar added documentation task Doesn't change any behaviour labels Jun 28, 2021
@8-legged-elephant
Copy link

I was trying to run a crawl with the uBlock Origin extension and I am unable to get it working.

The steps I took were:

  • Created a new firefox profile called 'uBO_profile'
  • Opened a new instance of firefox using that profile
  • Installed the uBlock Origin extension
  • Closed all instances of firefox
  • Located the profile directory and compressed it to a .tar file
  • In the demo.py file included, I set display_mode='native' and added seed_tar=Path('path/to/profile.tar')

image

  • Ran the crawl and did not see the extensions on the toolbar

image

image

This was done inside of a Linux mint VM.

One thing I noticed while trying to confirm that the profile was loaded is that the profile directory is created ( the uBO_profile ) inside of the firefox profile created in the tmp directory. But that may be intended.

@vringar
Copy link
Contributor Author

vringar commented Jun 29, 2021

I just remembered that we already wrote something on the topic.
See here.

It sounds to me like you tarred the profile directory instead of the contents of the profile directory.
That's why your profile is copied in a subfolder in the active profile instead overwriting the active profile.

@8-legged-elephant
Copy link

Okay, thanks for clarifying. I did not see the doc entry about profiles. I think it is because I do not have much experience with Firefox profiles, so I was looking for 'adding extensions' instead of 'adding profiles'.

I appreciate all the help.

@vringar
Copy link
Contributor Author

vringar commented Jun 29, 2021

No worries. I just had the feeling that I had already seen some docs for this. And then I found the solution to your error there.

I'll write up something explicitly mentioning add-ons

@MaazBinMusa
Copy link
Contributor

@8-legged-elephant Did you try just installing the xpi with selenium's install_addon function in the deploy_firefox.py file?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation task Doesn't change any behaviour
Projects
None yet
Development

No branches or pull requests

3 participants