Is the cost of security and self-preservation worth it?

Security has become a bit of a conversational past time the last couple of weeks. The Syrian refugee crisis and Paris attacks have, of course, brought this to a significant head. But the issue is not new and comes up with various issues, including gun control, police force, just war theory, etc.

My problem is that, like many issues, we have dichotomized the sides, which doesn't help any solution-finding. We need to validate that a sense of security for ourselves is important. But security for other people is important, too.

Assuming refugees pose various dangers to us (on Monday, I talked about my personal experience with Muslim peacemakers), is our safety more important than the safety of the refugees? Should we be putting our needs and (more commonly) comfort about the basic (often life and death-related) needs of others? It's human nature to do so, so it's understandable, but is it what we should strive to do?

When we start denying people asylum in order to protect ourselves from potential (not guaranteed) cultural changes and potential (again, not guaranteed) attacks, we should also not place these as opposites and acknowledge the true costs. Few people want cultural change, and no one wants the safety of their loved ones and themselves to be put at risk.

What we are saying is that maintaining our culture as it is is worth hundreds of thousands of lives of the Other who have no safe place to go. We are willing to let hundreds of thousands of innocent people live in limbo with a horrible quality of life with many likely dying in order to maintain a status quo culture and give us a sense of security. Is that cost worth it?

Let's assume for a moment that denying refugees prevents another 9/11-like attack, so we have saved 3,000 American lives. The cost is hundreds of thousands of refugees' lives. All are innocent victims. All would be tragedies. So are our lives worth more than theirs? What does it say about our value system that we put psychological security above human rights? The problem is the cost of denying refugees isn't ours to pay, at least in the short term and materialistically. It's theirs. But it's ultimately our cost morally.

What is our obligation to our fellow human? When do we put ourselves at risk in order to reduce the risk to someone else?

Should security be pursued at all costs? Is self-preservation or (wise) self-sacrifice for the sake of another the higher goal?