Windows Movie Maker outputs as either .wmv files or DV avi files. Neither play on most dvd players.
If you ran the results through Nero Vision to make them into dvd-video, then you would have something that would play on a stand alone player. You could also use the programs mentioned by t0nee1.
Windows DVD Maker can also produce a finished dvd for you from the files you get from Windows Movie Maker.