Yes, Microsoft is killing MS Paint in its Windows 10 Fall Creators update. Now let's suppose you wanted to rotate that square by 45 degrees. Consider the following image loaded up in mspaint.
Of course, it'll take a little bit of math, but it can be done. For example, rotating an image by an arbitrary angle.
MS Paint can do almost anything photoshop and many other advanced image editing programs.Search for icons from Font Awesome, Foundation, Glyphicons, IcoMoon, Ionicons, Material Design, and Octicons.