Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Keyword Spotting Application #2001

Open
wants to merge 137 commits into
base: main
Choose a base branch
from
Open

Keyword Spotting Application #2001

wants to merge 137 commits into from

Conversation

mufwan
Copy link
Contributor

@mufwan mufwan commented Feb 19, 2024

Added files to read wav files to cenvert wav files to a csv file.

Implemented an application for keyword Spotting.

jessicapriebe and others added 30 commits November 27, 2023 15:46
@jessicapriebe
implemented ComplexDouble, added LibMatrixFourier
b6c4590
@jessicapriebe
added pow for ComplexDouble, updated fft
189208c
@jessicapriebe
added complexDouble functions, simple Test
e73709e
@jessicapriebe
TODO: length of non power of two, added test
5f03898
@jessicapriebe
implemented fft2d + simple test
d185a10
@jessicapriebe
second test fft2d
ed99a8a
@fzoepffel
added numpy function to create fft output to feed in java test. added…
51c95a4 
… more methods to complexDouble and added ifft
@fzoepffel
added execution time checker
e46c73b
@jessicapriebe
fixed fft + fft2d
f61bcd4
@jessicapriebe
merged
0b2d4bf
@fzoepffel
added ifft and tests
8d959fc
@fzoepffel
added 2D ifft and tests
b652af3
@fzoepffel
added test for 2dfft
d7399ca
@fzoepffel
added dml builtin stuff
f4b1207
@jessicapriebe
removed complexDouble.pow
809e2d9
@jessicapriebe
added fft matrixblock 1 dim
bb79afe
fft for arrays with non-power-of-two length
f79d005
@jessicapriebe
fft matrixblock now supports both dim
b5a908f
@jessicapriebe
Merge branch 'main' of https://github.com/fzoepffel/systemds into main
e767f10
@jessicapriebe
added ifft_one_dim MatrixBlock
ddcdec9
@jessicapriebe
improved all fft MatrixBlock functions + separated from complex doubl…
9478200 
…e funtions
@jessicapriebe
FastMath
011568f
@jessicapriebe
fft integration in systemds
f6ae689
@fzoepffel
fixed a integration bug and adjusted tests on csv files to new functions
e51c825
@mufwan
Delete src/main/java/org/apache/sysds/runtime/matrix/data/LibMatrixFo…
b828668 
…urier2.java
@mufwan
Delete src/test/java/org/apache/sysds/test/component/matrix/Fourier2T…
8335fb7 
…est.java
@fzoepffel
ifft integration in dml
a8ae448
@fzoepffel
Merge branches 'main' and 'main' of https://github.com/fzoepffel/syst…
edd5a0b 
…emds
@fzoepffel
dml integration ifft
45e2a75
@fzoepffel
removed complexDouble
f9c3b70
jessicapriebe and others added 27 commits February 20, 2024 20:02
@jessicapriebe @fzoepffel
fixed
882be22
@jessicapriebe @fzoepffel
fixed
fde0258
@jessicapriebe @fzoepffel
fixed
73cae32
@jessicapriebe @fzoepffel
delete dir after extracting the data + formatting
b91d5e4
@jessicapriebe @fzoepffel
added save to CSV
eaa6fbd
@jessicapriebe @fzoepffel
removes debugging prints and added start and finish print for downloa…
990bd6c 
…ding
@jessicapriebe @fzoepffel
changed short/double to int
a2bb648
@jessicapriebe @fzoepffel
added TODO
75f22cb
@jessicapriebe @fzoepffel
converted bytearrayinputstream to audioinoutstream
a3f8153
@jessicapriebe @fzoepffel
fixed
c03359e
@jessicapriebe @fzoepffel
changed short/double to int
f09e2f8
@jessicapriebe @fzoepffel
removed url
005bbcd
@jessicapriebe @fzoepffel
changed logic
5267248
@jessicapriebe @fzoepffel
fixed writer
09356ef
@jessicapriebe @fzoepffel
merged application_zipstream into application
5e9e195
@jessicapriebe @fzoepffel
added suffix
3fc6e4d
@mufwan @fzoepffel
stft dml
be71987
@mufwan @fzoepffel
stft dml integration
b5fe741
@mufwan @fzoepffel
handle zero matrix
2da7ad3
@mufwan @fzoepffel
update stft
ed32efc
@mufwan @fzoepffel
branch to merge with application
985643b
@mufwan @fzoepffel
moved keywordSpotting.dml to scripts
a55190f
@mufwan @fzoepffel
add shuffle
9a2bc99
@jessicapriebe @fzoepffel
restricted to yes and no
1f8cf4b
@jessicapriebe @fzoepffel
addded formatting keyword spotting
b3d52ee
@mufwan @fzoepffel
without parallelization
711b766
@mufwan @fzoepffel
accuracy for application
481e42c
@Baunsgaard
Copy link
Contributor

I have decided against merging this PR at the moment, since it is adding files some places not ideal.
If you want to clean it up @mufwan then i will happily merge it.

Tasks:

  1. Move the scripts into scripts/staging
  2. Add documentation for how to run it inside the script, and what is expected.
  3. Rebase the PR to not contain the changes for FFT

While merging the STFT is slightly changed and not hooked up to DML correctly,
The main issue was that one method got overloaded to take a long vs int as arguments to choose the version to call.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
SystemDS PR Queue
Status: In Progress
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@mufwan @Baunsgaard @jessicapriebe @fzoepffel