You can indeed do this. It has multiple environmental factors though which make this a bad idea.
Paper is easily damaged and very degradable.
You could make a mistake. If you do intend to do this maybe its best to quadruple check it.
Lack of extra security - unless you have it locked away in a safety deposit back in the city undergrounds, someone who knows it is there could steal it. Data drives give you extra level of security with wallet encryption.
There are probably other reasons but these are the main three, if you do decide to just do this there are a few techniques you could use to improve these factors..
Try laminating it, will give the paper exponentially longer lifepan.
Miss out a character that only you will remember, replacing a single character of a private key is easy if you know where it goes but hard if your not you, obviously just don't forget it!
1This could simple be a confusion about terms. People call what you describe a "paper wallet." The term wallet does not only apply to Bitcoin keys stored on a computer, or even just digitally. Note that, indeed, you could simple just "store" a secret by memorizing it, and generate the secret key deterministically from that. People call this scheme a "brain wallet." – pyramids – 2013-11-15T09:45:58.023