EAGLE-4 combines a draft model with eagle-harness inside your inference engine to adapt speculative decoding to your hardware, batch and workload. Version 0.1.5 improves
EAGLE-4 combines a draft model with eagle-harness inside your inference engine to adapt speculative decoding to your hardware, batch and workload. Version 0.1.4 makes vLL
EAGLE-4 combines a draft model with eagle-harness inside your inference engine to adapt speculative decoding to your hardware, batch and workload. Version 0.1.3 brings na
EAGLE-4 0.1.2 updates eagle-harness on the 0.1.1 engines. On SGLang, EAGLE-4 decodes a batch without speculation wherever speculation would be slower, so the high-load re
EAGLE-4 0.1.1 updates eagle-harness and two engine builds. An SGLang server now needs only the draft path to serve EAGLE-4 and starts its first requests faster, and a new
…r the univariate drift calculator. Thanks for the eagle-eyed reading [@josecaloca](https://github.com/josecaloca)! [( 425)]((https://github.com/NannyML/nannyml/issues/425