After successful voting and refreshing the page, vote is gone

This is always the issue with the page cache. The plugin supports the use of cache plugins, but in that case, it needs to get current ratings through AJAX to avoid showing old cached page. The plugin includes Dynamic Load addon that will load rating blocks through AJAX. This addon is disabled by default, and if you use cache plugins, just enable this addon from plugin Settings -> Extensions panel.