Mathematical and computer modeling of investors competition