For now it doesn`t solve whole problem but definetly, make use less Vram. I suggest using optifine and reload chunks (f3+A) sometimes. Without shaders should work better. Didn`t test it in servers but should improve overall performance.
