Parallel Processing

Parallel execution in the PIPELINE pillar.

parallel

const processed = pipeline.parallel([
  () => processA(),
  () => processB(),
  () => processC()
])

Parallel Mapping

const processed = pipeline.map(
  items,
  async item => await processItem(item),
  {
    parallel: true,
    concurrency: 5,
    batchSize: 100
  }
)

Parallel Filtering

const filtered = pipeline.filter(
  items,
  async item => await validateItem(item),
  {
    parallel: true,
    concurrency: 10
  }
)

Next Steps

• PIPELINE Pillar
• Data Flow Operations
• Examples