Figure 1
Overview of implementation phases.
Figure 2a
MatSci-YAMZ user-generated definition.
Figure 2b
b MatSci-YAMZ LLM-generated definition.
Table 1a
LLM definitions for benchmark term ‘Anisotropy’, for which a standard textbook definition is ‘exhibiting different values of a property in different crystallographic directions’ (Callister and Rethwisch, 2020).
| MODEL NAME | THINKING MODE | LLM DEFINITION | LLM EXAMPLE |
|---|---|---|---|
| gemma3:27b | no | Property of a material exhibiting different properties when measured in different directions | Wood is anisotropic; it splits easily along the grain but is strong across it. |
| deepseek-r1 | no | The property of a material that exhibits different physical properties in different directions. | A carbon fiber composite material may have high strength along the direction of the fibers but lower strength perpendicular to them, demonstrating anisotropy. |
| yes | Anisotropy refers to the dependence of a material’s properties on direction, where these properties vary when measured from different directions. | Wood exhibits anisotropy as its strength is greater along the grain than across it; similarly, graphite shows varying hardness in different directions. | |
| qwen3:32b | no | The property of a material to exhibit different physical or mechanical properties in different directions. | Graphite shows anisotropy because it is soft and easily cleaved in one direction but rigid in another. |
| yes | A material property that varies with direction, resulting in different physical or mechanical behaviors depending on the orientation within the material. | Wood exhibits anisotropy in mechanical strength, being significantly stronger along the grain direction (longitudinal) than across the grain (transverse). | |
| gpt-oss | yes | The directional dependence of a material’s physical properties (e.g., electrical, thermal, magnetic, or mechanical). | The anisotropy of graphite causes it to conduct electricity strongly along the planes of carbon layers while remaining electrically insulating perpendicular to those planes. |
Table 1b
LLM tokens and TPS for benchmark term ‘Anisotropy’.
| MODEL NAME | THINKING MODE | TOKENS (DEFINITION + EXAMPLE) | TOKENS PER SECOND | TOTAL DURATION (SECONDS) |
|---|---|---|---|---|
| gemma3:27b | no | 40 | 5.24 | 8.56 |
| deepseek-r1 | no | 52 | 1.87 | 30.84 |
| yes | 424 | 1.57 | 270.1 | |
| qwen3:32b | no | 46 | 3.79 | 14.37 |
| yes | 372 | 3 | 124.11 | |
| gpt-oss | yes | 141 | 5.37 | 26.25 |
Figure 3
Database schema for MatSci-YAMZ PostgreSQL backend.