TensorBoard
TensorBoard is a powerful open source toolkit for tracking and visualizing metrics within individual models or for comparing performance between multiple models. Also included are some powerful debugging options that help you visually explore the model. TensorBoard was initially built for TensorFlow but is now supported by other frameworks such as PyTorch.
TensorboardX is a project that extends TensorBoard to other frameworks such as Chainer, MXnet, etc.
TensorBoard + Gradient
TensorBoards are first-class citizens in Gradient. A single Experiment or multiple Experiments can easily be added to TensorBoard without any setup or management.