Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support indexing request WARC records: #82

Merged
merged 7 commits into from
Nov 7, 2024
Merged

Commits on Nov 6, 2024

  1. support indexing HTTP request (and WARC) records:

    - support customizing --fields for cdxj indexing
    - support 'req.*' fields which only apply to request records, other headers apply to response/main record
    - support 'referrer' as special shortcut for 'req.http:referer'
    - tests: update tests to include 'req.http:cookie' include in cdx
    - tests: update tests to include 'referrer' in cdx
    
    version: bump to 2.4.0
    ikreymer committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4499294 View commit details
    Browse the repository at this point in the history
  2. add exports

    ikreymer committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    9687ec3 View commit details
    Browse the repository at this point in the history
  3. set version to 2.4.0-beta.0

    ikreymer committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    a9c3906 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3eb1784 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. cli: convert 'fields' param to array, add coerce to flatten multiple …

    …params
    
    types: add types for cli params
    ikreymer committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    9b5b46e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f88186b View commit details
    Browse the repository at this point in the history
  3. import cleanup, beta 2

    ikreymer committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    749c51a View commit details
    Browse the repository at this point in the history