Windows 8, 10

Go to Control Panel and click Languages

Select language you want set as primary for Windows interface.

Windows 8.0

Windows 8.1, 10

If a language package in not available on your PC, download that.

Once language package download and installation is finished you see this message.

Now you may set another language as primary