Andy Chu — 2018/05/24

What is xargs -P?

When is it useful?

  1. For productionizing data science and research (often CPU-intensive tasks).

    Example: RAPPOR Data Flow

  2. To run tests in parallel (especially with different test frameworks).

    [oil spec test demo]
  3. As a quick and dirty way to speed up anything else, including I/O-bound tasks.

     cat tasks | xargs wget ...