dist_helper

Functions

setup_distributed([backend, port])

AdaHessian Optimizer

Module Contents

dist_helper.setup_distributed(backend='nccl', port=None)

AdaHessian Optimizer Lifted from https://github.com/BIGBALLON/distribuuuu/blob/master/distribuuuu/utils.py Originally licensed MIT, Copyright (c) 2020 Wei Li