Investigators said Shabattai Kalmanovich, 60, was killed by gunmen who fired at his Mercedes from a passing car, Russian media reported.
His driver was seriously wounded in the attack but tried to chase the killers, reports said.
Mr Kalmanovich was well known in Russia as a music concert promoter and as a basketball sponsor.
His killing appeared to have been "carefully planned", a police official was quoted by ITAR-Tass news agency as saying.
In televised remarks, Moscow Investigative Committee chief Anatoly Bagmet said the killing could have been related to Mr Kalmanovich's business affairs or have been driven by "personal revenge".
Jailed for spying
Mr Kalmanovich emigrated from the former Soviet Union to Israel in 1971 and in 1988 was jailed for spying for the KGB, media reports said.
He was released after serving five years and relocated to Sierra Leone, where he made a fortune in the diamonds trade.
He later returned to Russia where he ran a large shopping centre in Moscow and promoted concerts for stars including Michael Jackson and Liza Minnelli.
Mr Kalmanovich also sponsored basketball clubs and in 2008 became general manager of the Russian women's basketball team.