Merge Main into Feature/4.0 #6747
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Update build templates * Update build templates to include all releases/* and feature/* * Update releases to release * Update triggers for PR Validation Build * Add triggers for Code Coverage
ghost
assigned 
Codecov Report
@@ Coverage Diff @@
## feature/4.0 #6747 +/- ##
===============================================
+ Coverage 68.89% 69.64% +0.75%
===============================================
Files 1216 1237 +21
Lines 250915 247617 -3298
Branches 26259 25436 -823
===============================================
- Hits 172857 172444 -413
+ Misses 71238 68561 -2677
+ Partials 6820 6612 -208
Flags with carried forward coverage won't be shown. Click here to find out more.
|
…frame (dotnet#6675) * Add missing implementation for datetime relevant arrow type * Return required usage
* Fix the behavior or column SetName method * Fix stack overflow exception * Fix merge issues --------- Co-authored-by: Michael Sharp <51342856+michaelgsharp@users.noreply.github.com>
…net#6710) * Fix error with allocating more than MaxCapacity of Byte Memory Buffer * Remove Unit test as it consumes too much memory * Fix issue with increasing buffer capacity over limit when double it size
…olumn size is more than 2 Gb) (dotnet#6724) * Fix dataframe arithmetics * Fix
…thods (dotnet#6723) * Provide ability to filter by null value * Add comments * Fix code review findings
* Step 1 * Step 2 * Fixed code review findings
* NER * QA almost done, runtime error * QA finished * fixes from PR comments * fixed build * build fixes * perf changes * made disposable * fixed not disposing model * added some disposables to TensorFlow for memory * build testing * fixing build * added missing dispose * build fixes * build fixes * testing macos fix
* Change methods signature generation * Change DataFrameColumn Arithmetics * Change DataFrameColumn Operations * Fix unit tests * Fix spaces * Fix code review findings
* Add QA sweepable * clean
…arameter names (dotnet#6766) Co-authored-by: John Doe <john@doe>
* Add target Type in convert type * Add custom type "DataKind" * clean * Add DataKind name space * clean test
…re`) (dotnet#6791) Co-authored-by: Lehonti Ramos <john@doe>
…re`) (dotnet#6790) Co-authored-by: Lehonti Ramos <john@doe>
* Fix issue with addIndexColumn in DataFrame.LoadCsv * Fix tests
….Core`) (dotnet#6788) Co-authored-by: Lehonti Ramos <john@doe>
…otnet#6789) Co-authored-by: Lehonti Ramos <john@doe>
* Fix inconsistent null handling in DataFrame Arithmetics * Fix Null Count and division by zero issues * Minor changes to restart build and rerun flaky tests
…e`) (dotnet#6792) Co-authored-by: Lehonti Ramos <john@doe>
…rom csv (dotnet#6782) * Use CultureInfo for parsing values in csv file * Fix merge issues
|
/azp run |
|
Azure Pipelines successfully started running 2 pipeline(s). |
* Append dataframe rows based on column names * Update DataFrame.cs --------- Co-authored-by: Michael Sharp <51342856+michaelgsharp@users.noreply.github.com>
* Fix wrong type conversion on PrimitiveDataFrameColumn * Added tests for dotnet#6829 * Fix test * Add file generated from tt template and fix unit tests --------- Co-authored-by: Aleksei Smirnov <tlalok@inbox.ru>
* update interactive kernel version * update * Update Microsoft.Data.Analysis.Interactive.Tests.csproj
…t#6827) * Add performance tests * Add extra tests * Fix * Fix typo * Fix Divide_Int16 and Divide_Int32_Int16 benchmarks * Fix * Change csproj file * Update BenchmarkDotNetVersion to 0.13.5 * Fix * Change to 0.13.1 because that is what is latest version in our nuget feeds. --------- Co-authored-by: Jake Radzikowski <JakeRad@Microsoft.com>
…otnet#6814) * Optimize PrimitiveColumnContainer.Clone method * Avoid unnecessary type conversion during binary operations * Remove using * Fix DataFrameBuffer constructor * remove uncorrectly added using * Make DataFrameBuffer Length field protected * Fix typo * Use RawSpan
* First step of tt refactoring * Step 2 * Step 3
* Initial structure and started fleshing out some sections * Some corrections and paragraph on DL usages * Starting fleshing out DL on ML.NET section * Addresses dotnet#6533
* Update dependencies * Add reference to NuGet.Packaging.Core
…erable mapIndices argument (dotnet#6822) * Split Test for AppendMany into 4 different tests * Block init of null validity buffer instead of setting individual bits * Add unit tests for PrimitiveDataFrameColumn.Clone * Fixes dotnet#6821 * Fix * Fix bug with AppendMany values to not empty column * Restart unit tests * Add more unit tests * Fix failing unit test * Fix code review findings
* Fix DataFrame incorrectly sets column value for index higher than Buffer.MaxCapacity * Revert renaming
…ns on nullable values (dotnet#6846) * Optimize PrimitiveColumnContainer.Clone method * Avoid unnecessary type conversion during binary operations * Remove using * Fix DataFrameBuffer constructor * remove uncorrectly added using * Make DataFrameBuffer Length field protected * Add performance tests * Split Test for AppendMany into 4 different tests * Block init of null validity buffer instead of setting individual bits * Add unit tests for PrimitiveDataFrameColumn.Clone * Fixes dotnet#6821 * Fix * Add extra tests * Fix * Fix typo * Fix Divide_Int16 and Divide_Int32_Int16 benchmarks * Fix * Avoid using constructor, that copies memory * First step of tt refactoring * Step 2 * Step 3 * Move iteration over buffers outside of the PrimitiveDataFrameColumnArithmetic * Change PrimitiveDataFrameColumnArithmetic * Fix typo * Use RawSpan * Fix bug with AppendMany values to not empty column * Restart unit tests * Add more unit tests * Add GetBitCount method * Fix failing unit test * Implementation * Change unit tests * Update unit tests * Refactoring BinaryOperation * Intermediate changes * Intermediate results * Implement Binary Scalar Reverse Operarions * Add implementation for BinaryIntOperations * Implement Comparison Operations * Implement actual calculations for Comparison operations * Uncomment performance tests * Remove unintentional code changes * Add reference to Apache Arrow project license in THIRD-PARTY-NOTICES * Fix license issues
dotnet#6851) * Fixes incorrect work of DataFrame with VBufferColumn when number of elements is greater than Int.MaxValue * Fix calculation of max capacity and amount of required buffers * Fix unit test * Run test allocating more than 2 Gb of memory on 64bit env only * Fix StringDataFrameColumn same way as VBufferDataFrameColumn * Fix wrong amount of buffers created in constructor of StringDataFrameColumn * Fix code review findings
JakeRadMSFT
force-pushed
the
u/jakerad/merge-main
branch
from
5d43a1d to
e72e985
Compare
ericstj
approved these changes
Oct 5, 2023
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Merging Latest Main into Feature/4.0 branch