People generally cannot voluntarily withdraw or stop participating in the Social Security program. You must pay Social Security taxes, regardless of you or your employer’s citizenship or place of residence. Unless specifically exempt by law, everyone working in the United States must pay Social Security taxes on earnings from covered employment. The law makes an exemption only in very limited circumstances for members of certain religious sects.