Investigate possible overflow cases on 32-bit systems

[sorsarre]

Thanks to @Drpsycho for pointing this one out.
Right now I'm only aware of std::min<size_t> / std::min<> places which are susceptible to this problem. Have to review the rest of it.