The relationship between Fulani herdsmen and farmers has in recent years become hot-tempered motivated by competitive control of land resources, particularly in central and north-east Nigeria. In Taraba State, the ongoing nomadic migration pattern from the Sahel in quest of pastures has led to violent confrontation between Fulani herdsmen and farming indigenous natives. Using a descriptive approach consisting of documented evidence, in-depth interviews, and focus group discussions, the analysis revealed that conflicts between Fulani herdsmen and indigenous native farmers have culminated in population displacement and destruction of life and property in numerous rural enclaves in Taraba State. Despite the consequences of the conflicts, the Taraba State government was unable to act proactively because of the centralization of command over Nigerian security agencies. Accordingly, the study suggests decentralization of security agencies in Nigeria, especially the police, as the way forward for effective security governance in Nigeria.