Data as of November 18, 2026 · How the score is built
Decision readingLFM2.5-8B-A1B scores 23.7 out of 100 and ranks #198 of 214. This profile shows 7 source-displayable benchmark rows; its strongest eligible category is Instruction Following at #130. Published weights can be self-hosted, but infrastructure cost varies and is not a comparable API token rate.
Email me when its price, rank or availability changes.
Capability
23.7/100
field median 49#198 of 214 ranked models
Public
#198of 214
Verified —
Price
Self-hosted; infrastructure cost varies
input median $0.60No comparable first-party hosted token rate
Speed
335tok/s
field median 92 tok/sFirst token 7.62 s
Context
128Ktokens
field median 256,000Reported for this model; direct source link not stored
Decision snapshot
Where this model sits in the ranked field, its strongest published evidence, and what to validate before choosing it. The marker compares it with the current ranked catalog, not with an absolute quality threshold.
Strongest published evidence
Instruction Following ranks #130. A well-rounded choice across a range of tasks.
Validate before choosing
7 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.
Source-linked · 7 displayable benchmark rows
Is LFM2.5-8B-A1B right for your job?
Its place on the LLM Selector’s job rankings, the same order the job pages publish. Describe your own job to see where it stands for that.
Where LFM2.5-8B-A1B ranks by benchmark score:
We keep what you type here, drafts included, for 180 days, and after that only the job and requirements read from it. Nothing is tied to your IP address or account. Leave out names and other personal details. Privacy
Category score record
Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%2 benchmarksVerified | Score pending | 2 benchmarks | Verified | |||
| CodingWeight 20%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| ReasoningRank #143 of 159Percentile 10thWeight 17%Not listedUnlisted sources | 21.6 | Not listed | Unlisted sources | |||
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| KnowledgeRank #159 of 179Percentile 11thWeight 12%Not listedUnlisted sources | 25.1 | Not listed | Unlisted sources | |||
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| Inst. FollowingRank #130 of 157Percentile 17thWeight 5%2 benchmarksVerified | 36.4 | 2 benchmarks | Verified | |||
| MathRank Not rankedWeight 5%3 benchmarksVerified | 20.7 | 3 benchmarks | Verified |
7 of 922 tracked benchmark slots have displayable evidence · bars run 0–100
Coverage detailsHow much of this is verified
Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.
- Agentic2/2 verified
- CodingNot measured
- ReasoningNot measured
- MultimodalNot measured
- KnowledgeNot measured
- MultilingualNot measured
- Inst. Following2/2 verified
- Math3/3 verified
Capability shape
Each axis shows percentile within that category’s eligible cohort. The comparison outline is the median of the six nearest public-score peers; a collapsed vertex means the category is not rank-eligible.
LFM2.5-8B-A1B category percentile values
- AgenticNot eligible
- CodingNot eligible
- Reasoning10th percentile
- MultimodalNot eligible
- Knowledge11th percentile
- MultilingualNot eligible
- Instruction following17th percentile
- MathNot eligible
The dashed outline is median of 6 nearest peers.
Eligible category ranks
- AgenticNot ranked
- CodingNot ranked
- Reasoning#143/159
- MultimodalNot ranked
- Knowledge#159/179
- MultilingualNot ranked
- Inst. Following#130/157
- MathNot ranked
Benchmark ledger
Every result says who ran the test. For this model, LiquidAI ran all 7. Agentic opens by default. The tick marks the best source-verified result in the catalog; provisional leaders do not set the reference.
Agentic2 rows
| Benchmark | Score | Versus best verified row | Gap | Who ran it | Use in ranking |
|---|---|---|---|---|---|
| BFCL v4Berkeley Function Calling Leaderboard v4 | 49.7% | Best verified: BTL-3 · 88.5% | Gap38.8 behind | Reported by LiquidAI | Counts3% ref. weight |
| τ²-bench resultsτ²-Bench Tool-Agent-User Evaluation | 88.1% | Best verified: GPT-5.4 · 98.9% | Gap10.8 behind | Reported by LiquidAI | Shown only |
Inst. Following2 rows
| Benchmark | Score | Versus best verified row | Gap | Who ran it | Use in ranking |
|---|---|---|---|---|---|
| IFBenchInstruction Following Benchmark | 56.5% | Best verified: Flint · 89.2% | Gap32.7 behind | Reported by LiquidAI | CountsWeighted 70% |
| IFEvalInstruction-Following Eval | 91.8% | Best verified: LFM2.5-24B-A2B · 96.8% | Gap4.9 behind | Reported by LiquidAI | Shown only |
Math3 rows
| Benchmark | Score | Versus best verified row | Gap | Who ran it | Use in ranking |
|---|---|---|---|---|---|
| AIME26AIME 2026 | 50.0% | Best verified: GLM-5.2 · 99.2% | Gap49.2 behind | Reported by LiquidAI | CountsWeighted 25% |
| MATH-500MATH-500 Problem Set | 88.8% | Best verified: Ternary Bonsai 2 27B · 98.8% | Gap10 behind | Reported by LiquidAI | Shown only |
| AIME 2025American Invitational Mathematics Examination 2025 | 42.5% | Best verified: GPT-5.2 · 100% | Gap57.5 behind | Reported by LiquidAI | Shown only |
Outlined bars are lab-reported. Filled bars are benchmark-run or independent. Bars run 0–100; the dark tick marks the best source-verified value.
Lineage
The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.
Reasoning
Spec sheet
Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.
- API model ID
- Not published
- Context window
- 128K
- Maximum output
- Not sourced yet
- Knowledge cutoff
- Not sourced yet
- Input modalities
- textLFM2.5-8B-A1B model card
- Output modalities
- textLFM2.5-8B-A1B model card
- Parameters
- Not sourced yet
- Availability
- Not sourced yet
- Cloud regions
- Not tracked yet
- Lifecycle
- Current
- API capabilities
- Tool calling, structured outputs, and batch support are not tracked yet
- Prompt caching
- Not documented in the pricing record
- Self-host
- LFM2.5-8B-A1B needs ~24GB VRAM (1× NVIDIA RTX 4090 (24GB)).
- Rate limits
- Not tracked yet
How to read this profile
The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.
LFM2.5-8B-A1B ranks #198 of 214 on the public leaderboard with a score of 23.69/100. It does not yet have enough sourced coverage for a verified position.
LFM2.5-8B-A1B is a open weight model with a 128K context window. It uses an explicit reasoning mode, which can improve complex problem solving while adding latency and token use.
7 of 922 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.
Its strongest eligible category is Instruction Following at #130, while its lowest eligible position is Knowledge at #159. a well-rounded choice across a range of tasks.
Last updated November 18, 2026. Runtime fields remain blank until a sourced snapshot exists.
Deployment options
Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.
Self-host vs API cost
Estimates at 50,000 req/day · 1000 tokens/req average.
Questions
How does LFM2.5-8B-A1B perform overall in AI benchmarks?
LFM2.5-8B-A1B ranks #198 out of 214 models on the public BenchAlign leaderboard, with a score of 23.69/100. Its evidence status is Estimated, and this profile shows 7 source-displayable benchmark rows. The label describes evidence depth, not a provider quality claim; inspect category rows before choosing a workload.
Is LFM2.5-8B-A1B good for mathematics?
LFM2.5-8B-A1B has source-displayable benchmark coverage for mathematics, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LFM2.5-8B-A1B good for agentic tool use and computer tasks?
LFM2.5-8B-A1B has source-displayable benchmark coverage for agentic tool use and computer tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LFM2.5-8B-A1B good for instruction following?
LFM2.5-8B-A1B ranks #130 out of 157 eligible models for instruction following, with a public category score of 36.4/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.
Is LFM2.5-8B-A1B open source?
LFM2.5-8B-A1B is an open-weight model from LiquidAI. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.
Does LFM2.5-8B-A1B have full benchmark coverage on BenchLM?
No. LFM2.5-8B-A1B currently has 14 source-displayable rows. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.
What is the context window size of LFM2.5-8B-A1B?
LFM2.5-8B-A1B has a reported context window of 128K in the exact-model catalog record. The value stays visible, but the profile marks its source link as unavailable instead of presenting it as directly documented. Maximum output length remains separate because providers often publish a different limit.