Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiproc #19

Merged
merged 28 commits into from
Sep 26, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
dc518d1
working multiproc very dirty
Psy-Fer Oct 20, 2022
3d8b1d8
add procs arg
Psy-Fer Oct 20, 2022
43c9021
writter queue
Psy-Fer Oct 20, 2022
024f1df
add biiiig queue energy
Psy-Fer Oct 20, 2022
a3f5604
cleanup and no missing reads
Psy-Fer Oct 20, 2022
17f059c
better batching and mathsssss
Psy-Fer Oct 20, 2022
1ca0354
revert batch splitting
Psy-Fer Oct 25, 2022
3238601
Add inout queue limit
Psy-Fer Nov 20, 2022
3ac6442
fix the input queue rate limiter
Psy-Fer Nov 21, 2022
f94d1e7
remove prints
Psy-Fer Nov 21, 2022
ad7755a
add --profile for benchmark debug
Psy-Fer Nov 24, 2022
44d8574
reduce sleep time to 0.01
Psy-Fer Nov 25, 2022
cdbe2ed
fix q split output files
Psy-Fer Dec 1, 2022
225ff99
Add read splitting, adapter trimming, meth calling
Psy-Fer Apr 13, 2023
0fa44c8
Bump to v0.3.0 for multiproc to become main branch
Psy-Fer Apr 13, 2023
999cc75
Bump version to v0.3.0
Psy-Fer Apr 13, 2023
983b424
batch < queue check and scaling progress output
Psy-Fer Apr 18, 2023
1c3a1fc
bump minimum python to account for better thread support
Psy-Fer Apr 18, 2023
855fff2
bump to v0.3.1
Psy-Fer Apr 18, 2023
ec4b3ae
add try/except on retrieving call
Psy-Fer Aug 4, 2023
8958b90
add scripts
hasindu2008 Sep 22, 2023
d219ea9
fix perm
hasindu2008 Sep 22, 2023
f0bba8a
fix cmd name
hasindu2008 Sep 22, 2023
7336c21
update readme
hasindu2008 Sep 22, 2023
92fc46c
fix read splitting not using new ID correctly
Psy-Fer Sep 25, 2023
5ef26ba
Merge branch 'multiproc' of github.com:Psy-Fer/buttery-eel into multi…
Psy-Fer Sep 25, 2023
e3a4ce0
version bump to 0.3.2
Psy-Fer Sep 25, 2023
c03489e
Merge branch 'main' into multiproc
Psy-Fer Sep 26, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@
long_description=long_description,
long_description_content_type="text/markdown",
packages=setuptools.find_packages(),
python_requires=">=3.6",
python_requires=">=3.8",
install_requires=install_requires,
setup_requires=["numpy"],
entry_points={"console_scripts":["buttery-eel=src.buttery_eel:main"],},
Expand Down
2 changes: 1 addition & 1 deletion src/_version.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
__version__="0.3.3"
__version__="0.3.3"
5 changes: 5 additions & 0 deletions src/buttery_eel.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,11 @@
skipped = 0


total_reads = 0
div = 50
skipped = 0


class MyParser(argparse.ArgumentParser):
def error(self, message):
sys.stderr.write('error: %s\n' % message)
Expand Down
1 change: 1 addition & 0 deletions test/install-eel.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ die(){

GUPPY_VERSION=7.1.4 #>6 is dorado


git clone https://github.com/Psy-Fer/buttery-eel -b main || die "git clone failed"
mv buttery-eel buttery-eel-0.3.1+${GUPPY_VERSION} || die "mv failed"
cd buttery-eel-0.3.1+${GUPPY_VERSION} || die "cd failed"
Expand Down