Philip Kiely · Baseten Books · 2026

Inference Engineering

Notes on a book about serving generative AI models in production. It starts from what to decide before optimizing, then moves through models, hardware, software, techniques, modalities and production. Every chapter has notes. The appendices are not covered.

Contents