Ivanov said such an organization should press the international community and individual countries to remove loopholes in international law and domestic legislation that allow terrorists and their allies to operate.
He said the United Nations should also eliminate what he called "double standards" when evaluating the terrorist threat.
He said attacks on military forces in Iraq were defined as terrorism while similar actions by militants in Russia were frequently presented as a struggle by the Chechen people for freedom and independence.
The Russian defense minister also criticized Western governments for delaying the ratification of a treaty on conventional forces in Europe.
The West has said it will not ratify the treaty, which was agreed in Istanbul in 1990 and amended in 1999, until Russia fulfils its commitment to withdraw its military forces from Georgia and Moldova's breakaway province of Transdniester.