Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build breaks if home directory has a go directory #22

Closed
pauldix opened this issue Nov 7, 2013 · 1 comment
Closed

Build breaks if home directory has a go directory #22

pauldix opened this issue Nov 7, 2013 · 1 comment

Comments

@pauldix
Copy link
Member

pauldix commented Nov 7, 2013

These lines:
https://github.com/influxdb/influxdb/blob/master/exports.sh#L7-L9

Cause OS X users that have a go directory in their home to not be able to build. I think it's because that is usually their GOPATH, but not their GOROOT, which is elsewhere. In any case, it causes them to not be able to build with failures about not being able to find all the things in stdlib
@ghost ghost assigned jvshahid Nov 7, 2013
@pauldix
Copy link
Member Author

pauldix commented Nov 7, 2013

cool, wasn't sure if doing that would break any of the linux builds

mgattozzi added a commit that referenced this issue Sep 5, 2024
@mgattozzi @pauldix
@hiltontj @alamb
feat: add compactor function for parquet files (#22)
48a0162 
This commit adds a new compaction function that takes in M files and
spits out N new files with a given limit. It sorts and dedupes based
off of the tags and time of the given parquet files. In the cases where
the time and tags are the same the data from the first file in the
passed in files is chosen.

Given two files with this tag set and a limit of two

1st: a, b, c, d, d
2nd: b, c, d

We'd create a record batch of:

a,b,b,c,c,d,d,d

which is 4 different series.

We will split it out into the following files:

1st: a
2nd: b, b
3rd: c, c
4th: d, d, d

In the first file the next series would go over the limit and it's a new
series so we close the file and start a new one. We only have 2 b for
the second one and 2 c for the 3rd one and so those are written out as
is. The 4th one however would "be over the limit", however we want data
for series to be colocated so we write out that entire series even if
that goes over the limit.

With this we'll be able to start work on the compaction scheduler so
that we can start compacting old data together which will help with
historical queries.

Closes #7

Note this commit also contains code synced from OSS.

---------

Co-authored-by: Paul Dix <paul@pauldix.net>
Co-authored-by: Trevor Hilton <thilton@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pauldix @jvshahid