You can use a role and user called "Everyone on the Internet", then just use the new record form on your website.
You will want to be very careful about the permissions and access, otherwise people could see your confidential information relatively easy.
On the other end, you can use a "Portal" which will avoid user counts and more security