Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Distributed Queries #2202

Merged
merged 21 commits into from
Apr 11, 2015
Merged

Distributed Queries #2202

merged 21 commits into from
Apr 11, 2015

Commits on Apr 10, 2015

  1. Update server and handler to work with streamed responses

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    5e82ca5 View commit details
    Browse the repository at this point in the history

  2. Add chunked responses and streaming of raw queries. 

    Refactored query engine to have different processing pipeline for raw queries. This enables queries that have a large offset to not keep everything in memory. It also makes it so that queries against raw data that have a limit will only p
rocess up to that limit and then bail out.

Raw data queries will only read up to a certain point in the map phase before yielding to the engine for further processing.

Fixes #2029 and fixes #2030
    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    2a3ed63 View commit details
    Browse the repository at this point in the history

  3. uncoment raw ordering test

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    728f5de View commit details
    Browse the repository at this point in the history

  4. WIP: Initial implementation of remote mapper for distributed queries.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    1139950 View commit details
    Browse the repository at this point in the history

  5. Fix errors on limits and chunked raw queries.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    6e8ea9a View commit details
    Browse the repository at this point in the history

  6. Remove the interval setting from NextInterval to make remote mappers … 

    …work.
    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    d41b85a View commit details
    Browse the repository at this point in the history

  7. Fix the group by multiple dimensions test to be correct.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    4a0c468 View commit details
    Browse the repository at this point in the history

  8. Fix wildcard group by query with time test to be correct.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    f5dfb14 View commit details
    Browse the repository at this point in the history

  9. Finish up distributed queries.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    7661546 View commit details
    Browse the repository at this point in the history

  10. Add change for distributed query engine

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    b353119 View commit details
    Browse the repository at this point in the history

  11. Fix opentsdb integration tests after rebase

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    8a25683 View commit details
    Browse the repository at this point in the history

  12. Use uint64 for Series IDs 

    Fixes issue #1649
    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    bf1a8aa View commit details
    Browse the repository at this point in the history

  13. Fixes based on feedback.

    @pauldix @otoolep
    pauldix authored and otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    37d4f2a View commit details
    Browse the repository at this point in the history

  14. Fix compilation errors after parser merge

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    9282a8a View commit details
    Browse the repository at this point in the history

  15. Use different base port range for DQ testing

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    559e1d4 View commit details
    Browse the repository at this point in the history

  16. 'reflect' is not used

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    350795d View commit details
    Browse the repository at this point in the history

  17. Hook up "run_mapper" in top-level handler 

    No doubt about it, URL routing is definitely brittle and needs work.
    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    2c554f4 View commit details
    Browse the repository at this point in the history

  18. Seems like partial replication reads take longer

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    925de06 View commit details
    Browse the repository at this point in the history

  19. Limix max remote response to 1MB 

    With a max remote reponse of 1GB, testing is unable to proceed.
    @otoolep
    otoolep committed Apr 10, 2015
    1 Configuration menu
    Copy the full SHA
    61d7d0e View commit details
    Browse the repository at this point in the history

  20. Update CHANGELOG

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    5882f0b View commit details
    Browse the repository at this point in the history

  21. Make it clearer in tests where numbers come from

    @otoolep
    otoolep committed Apr 10, 2015
    Configuration menu
    Copy the full SHA
    5890025 View commit details
    Browse the repository at this point in the history