The point of the SE line was never to provide a small phone, it was to provide a cheap phone. The first SE reused their manufacturing process from the 5/5s, and the later SEs used the chassis they were using from the 6 to the 8.