This. People are ignoring the distinction between positive and negative rights.
Most people recognize the right to life, f'rex. But even if they have a right to life, if I see somebody in a burning building and do not save them, I'm not liable. At worst I might be considered a complete jerk...