Optimal transport is a mathematical field focused on the most effective methods for moving mass between probability distributions. It has a broad range of applications in disciplines such as economics, physics, and machine learning. However, the optimization of probability measures in optimal transport frequently faces challenges due to complex cost functions influenced by various factors like physical dynamics of the system, obstacles, and varying terrains. Traditional methodologies struggle with these complex dynamics as they generally use simple cost functions like squared-Euclidean distance. Given the limits of existing methods, the need for more sophisticated techniques to manage these intricate cost functions in real-world scenarios is clear.
Researchers from the Center for Data Science at New York University and FAIR at Meta have come up with an innovative way to address these challenges. Their approach is to model the optimal transport problem using Lagrangian costs, which reflect the principle of least action in physical systems. By using neural networks, they can parameterize transport maps and paths and incorporate complex cost functions more effectively. The method allows for the inclusion of obstacles and changing terrain in the transport model, offering a more realistic representation of the system’s behavior.
The methodology involves parameterizing transport maps with neural networks specifically through neural ordinary differential equations (ODEs). The team used the NVIDIA Tesla V100 GPU for training, leading to improved performance in modeling complex transport paths. Complete with the system’s geometry and constraints represented in the cost functions, the method ensures the accurate and efficient learning of transport maps and paths.
The novel approach resulted in significant performance improvements. The model, when trained on the NVIDIA Tesla V100 GPU, was able to learn optimal transport maps within a period of 1-3 hours. Computational time was also reduced by approximately 30% compared to traditional methods. In complex transport scenarios involving obstacles and varying terrain, the method improved accuracy by 15% in cases with Gaussian mixtures and barriers. It also demonstrated robust results in benchmark datasets, maintaining high fidelity in transport maps and paths across different tests.
Impressively, this new approach outperforms traditional methods when handling real-world transport dynamics. It enhances computational efficiency and provides more accurate representations of transport paths. Its application extends to modeling fluid dynamics, traffic flow, and resource allocation in complex environments, making it a valuable tool in various fields from economics to physics and machine learning. With this innovative solution to the problem of optimizing transport under complex cost functions, the researchers from FAIR at Meta and New York University have paved the way for more sophisticated and practical solutions in the world of optimal transport.