Add multilib_policy=best to your /etc/yum.conf
Yum will now try to install the “best” package.arch for your system and it will only install that one (as long as it is available).
Assuming you’re on a 64-Bit system, yum will first try to install package.x86_64, if that doesn’t exist it will fall back to i386 and noarch.
The default setting is multilib_policy=all, which means to install all possible arches.