I just released gem bundler-unload an extension for Bundler allowing to unload bundler back to bundlerless state. The code was extracted from rubygems-bundler and is used now as dependency.