I'd be more concerned about the PSU (which is indeed from a very, very low quality manufacturer) frying the components and/or burning down the house.
Two examples other than Seasonic for good power supplies (300W will be enough for your configuration and a fair amount of future expansion) are:
*Corsair, whose PSUs are made by SeaSonic or Channel Well Technology - the former typically sell for slightly less than those Seasonic sell under their own name (the CWT ones are also very good).
*Antec is another reseller of SeaSonic and CWT PSUs and also of Delta, another good manufacturer)
The HD4670 would be a better choice for graphics. Both AMD and Nvidia have made newer cards, but the newer AMDs are probably pricier than what you seem to be aiming for, and the newer NVidias seem to be poor value for money.
If 1333MHz DDR3 is very close to the 1066MHz memory pricing at the store you plan to buy from, it might be an idea to consider getting that. With the current Athlon II you will not notice a performance difference, but if you upgrade the CPU in the future it will probably be an advantage. Ensure that the memory works at 1.5V - you can usually find this info on the manufacturers webpage.