Its far better to wait for someone who is right for you than to rush into something with someone who is not right for you. Love is something that happens, it cannot be manufactured.
Hindsight is usually perfect. All we can do is learn from the past and try to make the future as good as we can. If nothing else, at least we won't make the same mistakes again :)
RE: thy neighbor's husband.....!
This may be the start of some kind of attraction/obsession he may be developing.If he is making you nervous in any way at all, inform the local police and see what your options are.