Quite a long time ago, having briefly joined the herd of 20-something backpackers that eternally roams Southeast Asia, I found myself in Bali. Like all of the other 20-somethings, I carefully read the Lonely Planet backpacker’s guide to Indonesia and learned, among other things, that it was considered improper for women to wear shorts or trousers when entering Balinese temples. I dutifully purchased a Balinese sarong and, looking awkward and foreign, wore it while visiting temples. I didn’t want to cause offense.

I thought of that long-ago incident during a visit last week to London, where a full-fledged shouting match has broken out over Muslim women who choose to wear the veil. This particular argument had begun because a teaching assistant in Yorkshire refused to remove her veil – a niqab, which covers the whole body except for the eyes – in the presence of male teachers, which was much of the time. She was fired, she went to court – and a clutch of senior British politicians entered the fray.

Jack Straw, the former foreign secretary, called the full-face veil “a visible statement of separation and of difference.” Tony Blair, the prime minister, added that he could “see the reason” for the teaching assistant to be suspended.

What followed was predictable: accusations of racism, charges of discrimination and disagreement about whether the veil was even a valid topic of discussion. If Blair and Straw really were concerned about Muslim women, shouldn’t they be more interested in underage marriages, or wife beating, or something more important?

The short answer is, yes, probably. But the curious fact is that the veil, as a political issue, won’t go away. The French have banned not only the full veil but head scarves in state schools. Some German regions have banned the head scarf for civil servants, too, and they are not permitted in Turkish universities at all. Slowly, the issue is coming to the United States: Just this month a Michigan judge dismissed a small-claims court case filed by a Muslim woman because she refused to remove her full-face veil while testifying.

Critics call the veil a symbol of female oppression or rejection of Western values. Defenders say that it is a symbol of religious faith and that it allows women to be “free” in a different sense – free from cosmetics, from fashion and from unwanted male attention. Debate about the veil inevitably leads to discussions of female emancipation, religious freedom and the assimilation, or lack thereof, of Muslim communities in the West.

And yet, at a much simpler level, surely it is also true that the full-faced veil – the niqab, burqa or chador – causes such deep reactions in the West not so much because of its political or religious symbolism but because it is extremely impolite. Just as it is considered rude to enter a Balinese temple wearing shorts, so, too, is it considered rude, in a Western country, to hide one’s face. We wear masks when we want to frighten, when we are in mourning or when we want to conceal our identities. To a Western child – or even an adult – a woman clad from head to toe in black looks like a ghost. Thieves and actors hide their faces in the West; honest people look you straight in the eye.

Given that polite behavior is required in other facets of their jobs, it doesn’t seem to me in the least offensive to require schoolteachers or civil servants to show their faces when dealing with children or the public. If Western tourists can wear sarongs in Balinese temples to show respect for the locals, so too can religious Muslim women show respect for the children they teach and the customers they serve by leaving their head scarves on, but removing their full-faced veils.

It would, of course, be outrageous if Blair or the French government were to ban veils altogether – just as it is outrageous that Saudi Arabia bans churches and even forbids priests from entering the country. But just because authorities persecute Christians and Jews in some parts of the Muslim world, that doesn’t mean we need to emulate them.

In their private lives, Muslim women living in the West should be free to use veils or head scarves as they wish. But freedom to practice religion in the West shouldn’t imply freedom to hold jobs that impinge on that practice. An Orthodox Jew should not have an absolute right to work in a restaurant that is open only on Saturdays. A Quaker cannot join the Army and then state that his religion prohibits him from fighting. By the same token, a Muslim woman who wants to cover her face has no absolute right to work in a school or an office where face-to-face conversations are part of the job.

It isn’t religious discrimination or anti-Muslim bias to tell her that she must be polite to the natives, respect the local customs, try to speak some of the local patois – and uncover her face.