Skip to content

Add VBufferDataFrameCoumn to DataFrame - #6409

Merged
beccamc merged 14 commits into
dotnet:mainfrom
beccamc:u/beccam/vbuffer2
Jan 9, 2023
Merged

Add VBufferDataFrameCoumn to DataFrame#6409
beccamc merged 14 commits into
dotnet:mainfrom
beccamc:u/beccam/vbuffer2

Conversation

@beccamc

@beccamc beccamc commented Oct 25, 2022

Copy link
Copy Markdown
Contributor

Adding VBuffer type to the DataFrame. I modeled this off the of StringDataFrameColumn. I am not sure if a more complex approach is needed for the VBuffer type. An IDataView containing VBuffer type will convert to a DataFrame correctly.

Relevant issue: #5872

Comment thread src/Microsoft.Data.Analysis/IDataView.Extension.cs
@beccamc

beccamc commented Nov 28, 2022

Copy link
Copy Markdown
Contributor Author

@michaelgsharp could I get a review on this? Or @LittleLittleCloud?

@michaelgsharp

Copy link
Copy Markdown
Contributor

@beccamc looking into it now. Trying to figure out why things are failing.

@michaelgsharp

Copy link
Copy Markdown
Contributor

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).
@beccamc

beccamc commented Jan 3, 2023

Copy link
Copy Markdown
Contributor Author

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).
@beccamc

beccamc commented Jan 4, 2023

Copy link
Copy Markdown
Contributor Author

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).
@codecov

codecov Bot commented Jan 9, 2023

Copy link
Copy Markdown

Codecov Report

Merging #6409 (496681e) into main (ce0a5ba) will decrease coverage by 0.01%.
The diff coverage is 59.38%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6409      +/-   ##
==========================================
- Coverage   68.46%   68.44%   -0.02%     
==========================================
  Files        1165     1174       +9     
  Lines      246202   248037    +1835     
  Branches    25558    25909     +351     
==========================================
+ Hits       168550   169772    +1222     
- Misses      70967    71512     +545     
- Partials     6685     6753      +68     
Flag Coverage Δ
Debug 68.44% <59.38%> (-0.02%) ⬇️
production 62.83% <51.82%> (-0.04%) ⬇️
test 88.93% <100.00%> (-0.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/Microsoft.Data.Analysis/Strings.Designer.cs 42.36% <0.00%> (-0.91%) ⬇️
.../Microsoft.Data.Analysis/VBufferDataFrameColumn.cs 47.48% <47.48%> (ø)
src/Microsoft.Data.Analysis/IDataView.Extension.cs 91.72% <80.85%> (-4.20%) ⬇️
...oft.Data.Analysis.Tests/DataFrameIDataViewTests.cs 100.00% <100.00%> (ø)
...st/Microsoft.Data.Analysis.Tests/DataFrameTests.cs 99.24% <100.00%> (+<0.01%) ⬆️
...icrosoft.ML.FastTree/RandomForestClassification.cs 51.51% <0.00%> (-33.58%) ⬇️
src/Microsoft.ML.TorchSharp/Utils/FileUtils.cs 0.00% <0.00%> (-24.62%) ⬇️
...c/Microsoft.ML.FastTree/Utils/ThreadTaskManager.cs 79.48% <0.00%> (-20.52%) ⬇️
...rc/Microsoft.ML.FastTree/RandomForestRegression.cs 54.14% <0.00%> (-17.29%) ⬇️
...icrosoft.ML.TorchSharp/NasBert/Models/BaseModel.cs 66.66% <0.00%> (-14.92%) ⬇️
... and 76 more
@beccamc
beccamc merged commit 6708456 into dotnet:main Jan 9, 2023
@ghost ghost locked as resolved and limited conversation to collaborators Feb 9, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

2 participants