Facebook's AutoScale decides if AI inference runs on your phone or in the cloud

In a preprint paper, Facebook researchers describe AutoScale, a system that optimizes AI inference for energy efficiency on mobile and edge devices.