Howdie!
So I love comic books, but I am rather new to that little world (Mom thought they were evil and just recently let me start looking into them -_-). So basically, I want nothing with magic, sex or anything like that. I know that limits me quite a bit... But I am wondering if there are any 'innocent' comic books?

If there is, I appreciate it! :D

You could try some of the runs aimed at younger readers, like the Ultimate Spider Man run that has Miles Morales as Spiderman instead of Peter Parker. I'll keep thinking on it though. And I'd recommend asking at your local comic book shop. Usually the staff at those places are really friendly and know a lot about the comics that they're selling.