SVG can do more than is given credit for here, as it can embed jpegs and pngs for areas where they are optimal, while keeping text and lines crisp. Google’s drawing app is good for making these.
Amber has been investigating which image formats make sense for which situations.
Choosing image format is only one step towards optimising images on the web. There are many, many other steps to consider, and so, so much to learn!