Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tootctl domains crawl #9809

Merged
merged 1 commit into from
Jan 15, 2019
Merged

Add tootctl domains crawl #9809

merged 1 commit into from
Jan 15, 2019

Conversation

Gargron
Copy link
Member

@Gargron Gargron commented Jan 14, 2019

Usage:
  tootctl domains crawl [START]

Options:
  c, [--concurrency=N]          
                                # Default: 50
  s, [--silent], [--no-silent]  
  f, [--format=FORMAT]          
                                # Default: summary

Description:
  Crawl the fediverse by using the Mastodon REST API endpoints that expose all known
  peers, and collect statistics from those peers, as long as those peers
  support those API endpoints. When no START is given, the command uses this
  server's own database of known peers to seed the crawl.

  The --concurrency (-c) option controls the number of threads performing HTTP
  requests at the same time. More threads means the crawl may complete faster.

  The --silent (-s) option controls progress output.

  The --format (-f) option controls how the data is displayed at the end. By
  default (`summary`), a summary of the statistics is returned. The other
  options are `domains`, which returns a newline-delimited list of all
  discovered peers, and `json`, which dumps all the aggregated data raw.

@Gargron Gargron added the moderation Administration and moderation tooling label Jan 14, 2019
@Gargron Gargron force-pushed the feature-tootctl-crawl branch 2 times, most recently from 861b4c5 to 2e6a00d Compare January 14, 2019 17:56
@Gargron Gargron merged commit ee5e248 into master Jan 15, 2019
@ykzts ykzts deleted the feature-tootctl-crawl branch January 15, 2019 11:34
@dariusk dariusk mentioned this pull request Jan 25, 2019
6 tasks
hiyuki2578 pushed a commit to ProjectMyosotis/mastodon that referenced this pull request Oct 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
moderation Administration and moderation tooling
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants