Can I close my island while people are here?

I don't think so...

If they're not your friend, nope. If they're your friend/best friend, they may or may not get kicked if you close the island, I can't say for sure.