Continue to ignore it.  Our house is normally quiet--so really he/she could, perhaps, assume soon that we are not home.

What would you do if.......someone rings your doorbell near midnight  for a random pattern of nights then gets out of sight/off porch from your protected view?