RubyFlow The Ruby and Rails community linklog

Parallelising ETL workflows with the Jongleur gem

Jongleur is a process scheduler and manager. It allows its users to create a number of executable tasks as Ruby classes, define precedence between those tasks and run each task as a separate process. It’s particularly useful for implementing workflows modelled as a DAGs (Directed Acyclic Graph), but can be also used to run multiple tasks in parallel or even sequential workflows where each task needs to run as a separate OS process.

http://bootstrap.me.uk/gems/2019/01/06/jongleur-etl.html

Post a comment

You can use basic HTML markup (e.g. <a>) or Markdown.

As you are not logged in, you will be
directed via GitHub to signup or sign in