The incident took place during a prayer service at the city's Golden Temple on Saturday, according to local media.
The man allegedly barged into the inner sanctum, where Sikhism's holy book, the Guru Granth Sahib, is kept.
He then grabbed a ceremonial sword placed next to the book, but was overpowered by guards and worshippers.
Sikhs regard the Guru Granth Sahib as not just the holy scripture of their religion but also as the living Guru, and believe it should be treated with respect as a human might be.
