I’ve been using Kiba ETL (Ruby data processing framework) and Sidekiq together in production for a while now, to write flexible data synchronisation jobs.

While not complicated, it requires some considerations, so I have documented those here:

https://github.com/thbar/kiba/wiki/Considerations-for-running-Kiba-jobs-programmatically-(from-Sidekiq,-Faktory,-Rake,-...)

Happy data processing!