Benchmarks / True Electrochemical Health vs. Wang et al. 2024 PINN4SOHTrue Electrochemical Health Benchmark · vs. Wang et al. 2024 PINN4SOH

Benchmarked against the field's most cited physics-informed architecture.

Zylectra's Physics AI model for true electrochemical health, scored against Wang et al. 2024's PINN4SOH, published in Nature Communications and one of the most cited physics-informed architectures in the literature, chosen as the toughest available comparison, not a convenient one.

0.48%
pooled error rate (MAE)
vs. 0.82% for the two-checkpoint comparison
42%
fewer errors
pooled MAE vs. the two-checkpoint comparison
1 vs. 2
checkpoints shipped
one unified model vs. one per dataset
51%
fewer errors, harder dataset
vs. its dataset-specialized checkpoint
01 · Executive summary

One model, beating two specialized ones.

Zylectra's Physics AI model was benchmarked directly against Wang et al. 2024's PINN4SOH, the architecture the research community treats as the reference point for physics-informed health estimation. Both models were scored on two public LFP cycling datasets, MIT and HUST, using each project's own held-out test split. Zylectra's single model beat Wang's dataset-specialized checkpoint on both datasets, on every metric measured: MAE, RMSE, and R².

02 · Objective

Wang's PINN4SOH ships one specialized checkpoint per dataset. Zylectra trains one model across every dataset it supports, on principle: a fleet is never one dataset. This report tests whether that choice costs anything against a specialized alternative built by the reference implementation itself.

03 · Models compared
ModelTypeParamsTraining scope
Zylectra Physics AI modelPhysics-informed NN14,202One model, both datasets
Wang PINN4SOH: MITPhysics-informed NN13,662Specialized, MIT only
Wang PINN4SOH: HUSTPhysics-informed NN13,662Specialized, HUST only
04 · Head-to-head, per dataset

Same architecture family, two different bets on generalization.

MAE and RMSE in health fraction (0–1 scale; 0.01 = 1 percentage point) · lower is better. R² · higher is better.

MITZylectraWang
MAE0.53%0.58%
RMSE0.77%0.79%
0.9490.925
HUSTZylectraWang
MAE0.45%0.91%
RMSE0.58%1.13%
0.9930.978
05 · Pooled: one model vs. two specialized checkpoints
Zylectra · 1 checkpoint
0.48%
pooled MAE
Wang · 2 checkpoints
0.82%
n-weighted MAE

Wang's per-dataset specialization doesn't buy back what it costs: their two checkpoints together still trail Zylectra's one.

06 · Why it matters

No specialization tax

Zylectra's single model matches or beats each of Wang's specialized checkpoints on its own dataset, without retraining per source.

Built for fleets, not single datasets

A real fleet is never one dataset. Zylectra's one-model architecture is the assumption a multi-source fleet product has to hold; this comparison is evidence it holds without a performance cost.

07 · Computational cost
ModelParamsCheckpointsTotal params shippedTotal disk
Zylectra Physics AI model14,202114,20264 KB
Wang PINN4SOH13,662227,324118 KB

Wang's network is marginally smaller per checkpoint: the gap is Zylectra's wider input layer. But Wang's deployment needs to know which dataset a cell came from and load the matching checkpoint, or ship both. Zylectra ships one file, one code path.

08 · Limitations
  • Zylectra's and Wang's held-out test cells are independently constructed splits over the same public data, not a literal identical cell-for-cell rerun.
  • Zylectra's number is the best of a multi-seed training sweep; Wang's figure is a single run, matching how the original paper reports it. This asymmetry favors Zylectra's number being closer to its ceiling.
  • No comparison against proprietary commercial BMS firmware exists or is obtainable outside those vendors.
09 · Conclusion

Benchmarked directly against the architecture the field treats as its physics-informed reference, Zylectra's Physics AI model wins on both public datasets, on every metric, and does it with one unified checkpoint against Wang's two specialized ones. Physics-informed modeling built for a fleet, not a single dataset, doesn't cost accuracy to get there.

Have battery data and a problem worth solving?

Talk to us about what physics-informed health scoring looks like on your fleet.

Contact us

Zylectra · True electrochemical health benchmark · vs. Wang et al. 2024 PINN4SOH← All benchmark reports