Skip to content

Parallelize weaving #2

@dakota-hawkins

Description

@dakota-hawkins

Parallelize fastq weaving by splitting file into chucks, weaving on individual threads, writing to temporary files for each thread, and combining split temporary files to expected output

dirs = create_tmp_dirs(<number_of_threads>)
for write_dir in dirs:  # This is what we would need to parallelize 
    for (r1, r2, r3, r4), dir in zip(*reads):
        # weave
combine_output(dirs) 

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions