Well, there's a Venn diagram where there is overlap of legitimate concern over tracking people and these religious beliefs. OTOH SSNs are like the least of problems compared to how tracking is all over our digital lives.
Why couldn't the government use SSN to track people? There is no way to avoid tracking in situations where you need to identify yourself, regardless how you identify yourself, so why not make a robust way to identify yourself?