Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge branch 'main' into doc-latest #3908

Merged
merged 44 commits into from
Nov 7, 2023
Merged

Commits on Oct 10, 2023

  1. Configuration menu
    Copy the full SHA
    fb6277d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5d6b138 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3a328e6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6fc7da1 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. (PDB-5712) benchmark: use JDK http client instead of puppet's

    Some previous investigations have suggested that the puppet client has
    performance issues (at least the sync client), and recent pdb
    benchmarking has implied something similar -- it could only emulate
    about 80k hosts with a 30s run interval, no matter how many senders or
    simulation threads it had (on a 60-core, non-hyperthreaded server).
    
    We suspect the puppet client may be adding extra complexity by
    (if nothing else) emulating sync via its async client (rather than
    just using the Apache sync client directly), and since benchmark only
    needs to make synchronous POSTs from existing threads (the senders),
    switch to the straightforward JDK client.
    
    Preliminary testing was promising, and after fully implementing this,
    benchmark was able to emulate over 140k hosts on the server mentioned
    above, using the same randomization percentage of 100.  Guessing that
    we might now be hitting a CPU constraint, we changed the randomization
    to 10 percent, and were able to emulate at least 200k hosts.
    
    Fixes: puppetlabs#3886
    rbrw committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    dc2033c View commit details
    Browse the repository at this point in the history
  2. (PDB-5712) benchmark: rename --threads to --senders

    More accurately describe what it does in preparation for adding an
    option to adjust the simulator pool size too.  Leave the old option as
    a deprecated alias.
    rbrw committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    d194367 View commit details
    Browse the repository at this point in the history
  3. (PDB-5712) benchmark: change --senders default to 1/2 cores

    Change the --senders default to 2 or half the available cores,
    whichever is larger.  Testing with the new JDK client (where each
    sender is handling everything itself), found that with a 60
    core (non-hyperthreaded) host, only 16 senders were needed to hit a
    maximum rate with the local PuppetDB/PostgreSQL hosts.
    rbrw committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    1b87cd7 View commit details
    Browse the repository at this point in the history
  4. (PDB-5712) benchmark: set simulation threads via --simulators (cores …

    …/ 2)
    
    Add a --simulators option to allow customizing the simulation thread
    count (previously just 4).  Set the default to 2 or half the available
    cores, whichever is larger.  Of the values examined, testing the new
    JDK client on a 60 core (non-hyperthreaded) host reached the highest
    commands/sec rate with 16 senders and 16 simulators.
    rbrw committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    8394053 View commit details
    Browse the repository at this point in the history
  5. Merge pull request puppetlabs#3888 from rbrw/pdb-5712-move-benchmark-…

    …to-jdk-client
    
    (PDB-5712) Move benchmark to JDK client
    rbrw authored Oct 11, 2023
    Configuration menu
    Copy the full SHA
    2f8017f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    92ad833 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4ec32ba View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. (PE-36861) Update ezbake to 2.5.4

    nmburgan authored and austb committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    39ed16e View commit details
    Browse the repository at this point in the history
  2. Merge 7.x into main

    austb committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    9c556a8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a053de1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ac4245a View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Configuration menu
    Copy the full SHA
    2369c0b View commit details
    Browse the repository at this point in the history
  2. Merge pull request puppetlabs#3893 from puppetlabs/nmburgan-patch-1

    (PE-36861) Update ezbake to 2.5.5
    nmburgan authored Oct 16, 2023
    Configuration menu
    Copy the full SHA
    c014699 View commit details
    Browse the repository at this point in the history
  3. Merge 7.x into main

    austb committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    0f76e29 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Configuration menu
    Copy the full SHA
    e690cd1 View commit details
    Browse the repository at this point in the history
  2. (PDB-5712) submit-command-via-http!: switch to option map

    Move the timeout and ssl otions to an option map in preparation for an
    option to select the post method (http client).
    rbrw committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    d0bd627 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6fd7e97 View commit details
    Browse the repository at this point in the history
  4. (PDB-5712) submit-facts/submit-catalog/submit-report: generalize opts

    Change the ssl-opts arg to opts in preparation for passing a custom
    :post.
    rbrw committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    81d898b View commit details
    Browse the repository at this point in the history
  5. (PDB-5712) client: restore puppet client for command posts

    Use the new :post option to only post via the JDK client from
    benchmark because we use the submit-* functions in both pdb and pdbext
    tests, and those cause fips tests to fail with the current JDK client
    configuration, e.g.:
    
      actual: java.lang.InternalError:
      java.security.NoSuchAlgorithmException: Unable to invoke creator for
      DEFAULT: Default key/trust managers unavailable
    
    This should restore the puppet http client as of
    6fc7da1 (just before the switch to
    the JDK client in dc2033c) as the
    default client for command submission.
    rbrw committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    375c097 View commit details
    Browse the repository at this point in the history
  6. Merge pull request puppetlabs#3895 from rbrw/pdb-5712-fix-fips

    (PDB-5712) Fix FIPS tests after benchmark switch to JDK client
    austb authored Oct 17, 2023
    Configuration menu
    Copy the full SHA
    d47b8e0 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Configuration menu
    Copy the full SHA
    035c668 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. (PE-35601) Add a cert number --offset to Benchmark

    Allows you to run two or more Benchmark instances in parallel,
    offsetting the generated cert numbers so that the commands don't
    collide in the database. Let's you test massively when number of
    simulated nodes exceeds what a single Benchmark can push.
    jpartlow authored and austb committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    69daaa5 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. Configuration menu
    Copy the full SHA
    0ab2a4f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cf7c2b8 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Configuration menu
    Copy the full SHA
    2be9876 View commit details
    Browse the repository at this point in the history
  2. Merge pull request puppetlabs#3897 from steveax/PDB-5708-update-version

    (PDB-5708) update version for 8.2.0 release
    steveax authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    9687b75 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e8943d2 View commit details
    Browse the repository at this point in the history
  4. Merge pull request puppetlabs#3899 from steveax/PDB-5708-add-lein-exec

    (PDB-5708) add lein-exec to ci profile
    jonathannewman authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    4feab9f View commit details
    Browse the repository at this point in the history
  5. Version 8.2.0

    puppetlabs-jenkins committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    8ee3137 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    eaf8e8d View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. (PUP-11899) update integration tests for new Puppet log message

    starting in commit 71c7cd2d126f45bab2262e3ccee2ce0e4852dd24 Puppet will
    log which server the catalog is requested from.
    austb committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    1a26c1c View commit details
    Browse the repository at this point in the history
  2. Merge 7.x into main

    austb committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    5a792a2 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. (maint) Remove unnecessary Puppet version checks

    PuppetDB 8 only needs to maintain compatibility with Puppet 7 and 8, so
    it will not test Puppet 6
    austb authored and rbrw committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    2e7918b View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. Configuration menu
    Copy the full SHA
    d7ae724 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7cae60e View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Merge pull request puppetlabs#3903 from steveax/PDB-5700-7.15.0-relea…

    …se-notes
    
    (PDB-5700) 7.15.0 release notes
    steveax authored Nov 7, 2023
    Configuration menu
    Copy the full SHA
    f742e74 View commit details
    Browse the repository at this point in the history
  2. Merge pull request puppetlabs#3904 from steveax/PDB-5707-8.2.0-releas…

    …e-notes
    
    (PDB-5707) 8.2.0 release notes
    steveax authored Nov 7, 2023
    Configuration menu
    Copy the full SHA
    ca3f81f View commit details
    Browse the repository at this point in the history
  3. Merge branch '7.x'

    * 7.x:
      (PDB-5700) 7.15.0 release notes
    steveax committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    abf68e8 View commit details
    Browse the repository at this point in the history
  4. Merge pull request puppetlabs#3906 from steveax/main

    Merge branch '7.x'
    jonathannewman authored Nov 7, 2023
    Configuration menu
    Copy the full SHA
    28050da View commit details
    Browse the repository at this point in the history
  5. Merge branch 'main' into doc-latest

    * main: (31 commits)
      (PDB-5707) 8.2.0 release notes
      (PDB-5700) 7.15.0 release notes
      (maint) Remove unnecessary Puppet version checks
      (PUP-11899) update integration tests for new Puppet log message
      Version 8.2.1-SNAPSHOT
      Version 8.2.0
      (PDB-5708) add lein-exec to ci profile
      (PDB-5708) update version for 8.2.0 release
      (maint) Update version to 7.15.1-SNAPSHOT
      (maint) Update version to 7.15.0 for release
      (PE-35601) Add a cert number --offset to Benchmark
      Set clj-parent=7.2.6
      (PDB-5712) client: restore puppet client for command posts
      (PDB-5712) submit-facts/submit-catalog/submit-report: generalize opts
      (PDB-5712) submit-command-via-http!: select send function via :post
      (PDB-5712) submit-command-via-http!: switch to option map
      Set clj-parent=5.6.6
      (PE-36861) Update ezbake to 2.5.5
      Set clj-parent=7.2.5
      Set clj-parent=5.6.5
      ...
    steveax committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    f21561a View commit details
    Browse the repository at this point in the history