Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm surprised the CPU would in any way be the bottleneck for transferring data. Is it really faster to parallelize that?


It's more GNU Parallel has host groups in a config so you can send files for a job to the right one where its going to execute and bring things back. Essentially it can turn a local xargs type job into any kind of remote task execution including dealing with files locally needing to be remote.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: