Small Language Models in Production: Optimizing inference, reducing costs, and delivering enterprise-ready AI with quantization and distillation methods
Small Language Models in Production: Optimizing inference, reducing costs, and delivering enterprise-ready AI with quantization and distillation methods
Ship enterprise ready AI that is fast, affordable, and controllable with small language models engineered through quantization and distillation. Many teams want the benefits of language models, but costs, latency, and compliance block real progress. This book focuses on making production systems work on real infrastructure, with methods that lower memory use, improve tokens per second, and keep behavior auditable. You will see where small models beat larger ones, how to size fleets for peak demand, and how to align ...
Read More
Ship enterprise ready AI that is fast, affordable, and controllable with small language models engineered through quantization and distillation. Many teams want the benefits of language models, but costs, latency, and compliance block real progress. This book focuses on making production systems work on real infrastructure, with methods that lower memory use, improve tokens per second, and keep behavior auditable. You will see where small models beat larger ones, how to size fleets for peak demand, and how to align performance targets with budgets. The material is grounded in healthcare, finance, retail, and manufacturing examples, so the guidance maps cleanly to day to day decisions. You will learn practical approaches that move beyond proofs of concept. The book explains how to compress and serve models without losing essential quality, how to benchmark instruction following and safety, and how to meet obligations under current governance standards. Each topic connects to production tasks, such as rollout planning, model monitoring, and incident response. The goal is clear, help you deploy reliable systems that meet service levels and cost controls. apply weight only quantization with int8 or int4 using gptq and awq use activation quantization including smoothquant and fp8 reduce long context costs with kv cache quantization and eviction serve at scale with vllm paged attention and continuous batching tune tensorrt llm schedulers for throughput and tail latency deploy hugging face tgi on gaudi and inferentia2 use speculative decoding and inflight batching in production plan hardware across h100 h200 b200 and evaluate gaudi 3 model tokens per second ttft and end to end throughput run edge and on device with llamacpp gguf mlc webgpu and apple mlx convert pipelines to gguf onnx directml openvino ir and nncf evaluate with mt bench and ifeval plus safety multilingual math and code map risks with owasp llm top 10 and set enterprise controls operate under eu ai act timelines and the nist ai rmf profile build logging monitoring canaries autoscaling and rollback plans Code heavy guide : includes working examples, configs, and commands that you can adapt to real services, from serving stacks to evaluation pipelines. Get the playbook for small language models in production, and start building systems that are fast, cost aware, and ready for enterprise use, grab your copy today.
Read Less
Add this copy of Small Language Models in Production: Optimizing to cart. $30.58, like new condition, Sold by GreatBookPricesUK5 rated 5.0 out of 5 stars, ships from Castle Donington, DERBYSHIRE, UNITED KINGDOM, published 2025 by Independently Published.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
Fine. Trade paperback (US). Glued binding. 278 p. In Stock. 100% Money Back Guarantee. Brand New, Perfect Condition, allow 4-14 business days for standard shipping. To Alaska, Hawaii, U.S. protectorate, P.O. box, and APO/FPO addresses allow 4-28 business days for Standard shipping. No expedited shipping. All orders placed with expedited shipping will be cancelled. Over 3, 000, 000 happy customers.
Add this copy of Small Language Models in Production: Optimizing to cart. $30.87, new condition, Sold by GreatBookPricesUK5 rated 5.0 out of 5 stars, ships from Castle Donington, DERBYSHIRE, UNITED KINGDOM, published 2025 by Independently Published.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
New. Trade paperback (US). Glued binding. 278 p. In Stock. 100% Money Back Guarantee. Brand New, Perfect Condition, allow 4-14 business days for standard shipping. To Alaska, Hawaii, U.S. protectorate, P.O. box, and APO/FPO addresses allow 4-28 business days for Standard shipping. No expedited shipping. All orders placed with expedited shipping will be cancelled. Over 3, 000, 000 happy customers.
Add this copy of Small Language Models in Production: Optimizing to cart. $33.14, new condition, Sold by Ingram Customer Returns Center rated 5.0 out of 5 stars, ships from NV, USA, published 2025 by Independently Published.
Add this copy of Small Language Models in Production to cart. $41.92, new condition, Sold by Paperbackshop rated 5.0 out of 5 stars, ships from Bensenville, IL, UNITED STATES, published 2025 by Independently Published.
Add this copy of Small Language Models in Production: Optimizing to cart. $40.22, like new condition, Sold by GreatBookPrices rated 4.0 out of 5 stars, ships from Columbia, MD, UNITED STATES, published 2025 by Independently Published.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
Fine. Trade paperback (US). Glued binding. 278 p. In Stock. 100% Money Back Guarantee. Brand New, Perfect Condition, allow 4-14 business days for standard shipping. To Alaska, Hawaii, U.S. protectorate, P.O. box, and APO/FPO addresses allow 4-28 business days for Standard shipping. No expedited shipping. All orders placed with expedited shipping will be cancelled. Over 3, 000, 000 happy customers.
Add this copy of Small Language Models in Production: Optimizing to cart. $40.56, new condition, Sold by GreatBookPrices rated 4.0 out of 5 stars, ships from Columbia, MD, UNITED STATES, published 2025 by Independently Published.
Choose your shipping method in Checkout. Costs may vary based on destination.
Seller's Description:
New. Trade paperback (US). Glued binding. 278 p. In Stock. 100% Money Back Guarantee. Brand New, Perfect Condition, allow 4-14 business days for standard shipping. To Alaska, Hawaii, U.S. protectorate, P.O. box, and APO/FPO addresses allow 4-28 business days for Standard shipping. No expedited shipping. All orders placed with expedited shipping will be cancelled. Over 3, 000, 000 happy customers.
Add this copy of Small Language Models in Production: Optimizing to cart. $61.46, good condition, Sold by Bonita rated 4.0 out of 5 stars, ships from Santa Clarita, CA, UNITED STATES, published 2025 by Independently published.
