I’d say the main things likely holding you back are your CPU and RAM. This game is quite inefficient with respect to memory usage and (in)famously only runs on one core. That is going to hurt. Hopefully more optimization will happen in the future, but as of now it looks like your specs are nowhere near good enough.
According to the official minimum specs you should be able to run the game, but they are a lie. 4GB RAM is unfortunately too few to run the game in its current state. On the bright side, you can expect a big update coming this month that promises to correct many of the performance issues, as well as some improvements. Stay tuned!